Oct 20 18:01:43 user nova-compute[74233]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74233) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 18:01:43 user nova-compute[74233]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74233) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 18:01:43 user nova-compute[74233]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74233) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 18:01:43 user nova-compute[74233]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 18:01:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:01:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:01:43 user nova-compute[74233]: INFO nova.virt.driver [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 18:01:44 user nova-compute[74233]: INFO nova.compute.provider_config [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Acquiring lock "singleton_lock" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Acquired lock "singleton_lock" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Releasing lock "singleton_lock" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Full set of CONF: {{(pid=74233) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ******************************************************************************** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Configuration options gathered from: {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ================================================================================ {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] allow_resize_to_same_host      = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] arq_binding_timeout            = 300 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] backdoor_port                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] backdoor_socket                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] block_device_allocate_retries  = 300 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] block_device_allocate_retries_interval = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cert                           = self.pem {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute_monitors               = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] config_dir                     = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] config_drive_format            = iso9660 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] config_source                  = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] console_host                   = user {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] control_exchange               = nova {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cpu_allocation_ratio           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] daemon                         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] debug                          = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] default_access_ip_network_name = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] default_availability_zone      = nova {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] default_ephemeral_format       = ext4 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] default_green_pool_size        = 1000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] default_schedule_zone          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] disk_allocation_ratio          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] enable_new_services            = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] enabled_ssl_apis               = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] flat_injected                  = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] force_config_drive             = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] force_raw_images               = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] graceful_shutdown_timeout      = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] heal_instance_info_cache_interval = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] host                           = user {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_build_timeout         = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_delete_interval       = 300 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_name_template         = instance-%08x {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_usage_audit           = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_usage_audit_period    = month {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] internal_service_availability_zone = internal {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] key                            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] live_migration_retry_count     = 30 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_config_append              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_dir                        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_file                       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_options                    = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_rotate_interval            = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_rotate_interval_type       = days {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] log_rotation_type              = none {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] long_rpc_timeout               = 1800 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] max_concurrent_builds          = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] max_concurrent_live_migrations = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] max_concurrent_snapshots       = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] max_local_block_devices        = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] max_logfile_count              = 30 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] max_logfile_size_mb            = 200 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] maximum_instance_delete_attempts = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metadata_listen                = 0.0.0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metadata_listen_port           = 8775 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metadata_workers               = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] migrate_max_retries            = -1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] mkisofs_cmd                    = genisoimage {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] my_ip                          = 10.0.0.210 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] network_allocate_retries       = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] osapi_compute_listen_port      = 8774 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] osapi_compute_unique_server_name_scope =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] osapi_compute_workers          = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] password_length                = 12 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] periodic_enable                = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] periodic_fuzzy_delay           = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] pointer_model                  = ps2mouse {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] preallocate_images             = none {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] publish_errors                 = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] pybasedir                      = /opt/stack/nova {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ram_allocation_ratio           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rate_limit_burst               = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rate_limit_except_level        = CRITICAL {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rate_limit_interval            = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reboot_timeout                 = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reclaim_instance_interval      = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] record                         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reimage_timeout_per_gb         = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] report_interval                = 120 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rescue_timeout                 = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reserved_host_cpus             = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reserved_host_disk_mb          = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reserved_host_memory_mb        = 512 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] reserved_huge_pages            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] resize_confirm_window          = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] resize_fs_using_block_device   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] resume_guests_state_on_host_boot = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rpc_response_timeout           = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] run_external_periodic_tasks    = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] running_deleted_instance_action = reap {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] running_deleted_instance_timeout = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler_instance_sync_interval = 120 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_down_time              = 720 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] servicegroup_driver            = db {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] shelved_offload_time           = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] shelved_poll_interval          = 3600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] shutdown_timeout               = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] source_is_ipv6                 = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ssl_only                       = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] state_path                     = /opt/stack/data/nova {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] sync_power_state_interval      = 600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] sync_power_state_pool_size     = 1000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] syslog_log_facility            = LOG_USER {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] tempdir                        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] timeout_nbd                    = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] transport_url                  = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] update_resources_interval      = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_cow_images                 = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_eventlog                   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_journal                    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_json                       = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_rootwrap_daemon            = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_stderr                     = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] use_syslog                     = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vcpu_pin_set                   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plugging_is_fatal          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plugging_timeout           = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] virt_mkfs                      = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] volume_usage_poll_interval     = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] watch_log_file                 = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] web                            = /usr/share/spice-html5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_concurrency.disable_process_locking = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.auth_strategy              = keystone {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.compute_link_prefix        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.dhcp_domain                = novalocal {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.enable_instance_password   = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.glance_link_prefix         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.instance_list_per_project_cells = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.list_records_by_skipping_down_cells = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.local_metadata_per_cell    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.max_limit                  = 1000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.metadata_cache_expiration  = 15 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.neutron_default_tenant_id  = default {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.use_forwarded_for          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.use_neutron_default_nets   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_dynamic_targets = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_jsonfile_path   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.backend_argument         = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.config_prefix            = cache.oslo {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.dead_timeout             = 60.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.debug_cache_backend      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.enable_retry_client      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.enable_socket_keepalive  = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.enabled                  = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.expiration_time          = 600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.hashclient_retry_attempts = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_dead_retry      = 300 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_password        =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_sasl_enabled    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.memcache_username        =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.proxies                  = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.retry_attempts           = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.retry_delay              = 0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.socket_keepalive_count   = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.socket_keepalive_idle    = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.socket_keepalive_interval = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.tls_allowed_ciphers      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.tls_cafile               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.tls_certfile             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.tls_enabled              = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cache.tls_keyfile              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.auth_section            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.auth_type               = password {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.cafile                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.certfile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.collect_timing          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.cross_az_attach         = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.debug                   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.endpoint_template       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.http_retries            = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.insecure                = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.keyfile                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.os_region_name          = RegionOne {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.split_loggers           = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cinder.timeout                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.cpu_dedicated_set      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.cpu_shared_set         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.image_type_exclude_list = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.resource_provider_association_refresh = 300 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.shutdown_retry_interval = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] conductor.workers              = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] console.allowed_origins        = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] console.ssl_ciphers            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] console.ssl_minimum_version    = default {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] consoleauth.token_ttl          = 600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.cafile                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.certfile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.collect_timing          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.connect_retries         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.connect_retry_delay     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.endpoint_override       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.insecure                = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.keyfile                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.max_version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.min_version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.region_name             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.service_name            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.service_type            = accelerator {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.split_loggers           = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.status_code_retries     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.timeout                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] cyborg.version                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.backend               = sqlalchemy {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.connection            = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.connection_debug      = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.connection_parameters =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.connection_recycle_time = 3600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.connection_trace      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.db_inc_retry_interval = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.db_max_retries        = 20 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.db_max_retry_interval = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.db_retry_interval     = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.max_overflow          = 50 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.max_pool_size         = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.max_retries           = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.mysql_wsrep_sync_wait = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.pool_timeout          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.retry_interval        = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.slave_connection      = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] database.sqlite_synchronous    = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.backend           = sqlalchemy {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.connection        = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.connection_debug  = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.connection_parameters =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.connection_recycle_time = 3600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.connection_trace  = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.db_inc_retry_interval = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.db_max_retries    = 20 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.db_max_retry_interval = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.db_retry_interval = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.max_overflow      = 50 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.max_pool_size     = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.max_retries       = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.pool_timeout      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.retry_interval    = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.slave_connection  = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] api_database.sqlite_synchronous = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] devices.enabled_mdev_types     = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ephemeral_storage_encryption.enabled = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.api_servers             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.cafile                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.certfile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.collect_timing          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.connect_retries         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.connect_retry_delay     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.debug                   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.default_trusted_certificate_ids = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.enable_certificate_validation = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.enable_rbd_download     = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.endpoint_override       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.insecure                = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.keyfile                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.max_version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.min_version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.num_retries             = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.rbd_ceph_conf           =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.rbd_connect_timeout     = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.rbd_pool                =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.rbd_user                =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.region_name             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.service_name            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.service_type            = image {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.split_loggers           = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.status_code_retries     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.timeout                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.verify_glance_signatures = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] glance.version                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] guestfs.debug                  = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.config_drive_cdrom      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.config_drive_inject_password = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.enable_remotefx         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.instances_path_share    =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.limit_cpu_features      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.use_multipath_io        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.vswitch_name            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] mks.enabled                    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] image_cache.manager_interval   = 2400 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] image_cache.precache_concurrency = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] image_cache.remove_unused_base_images = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] image_cache.subdirectory_name  = _base {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.api_max_retries         = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.api_retry_interval      = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.auth_section            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.auth_type               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.cafile                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.certfile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.collect_timing          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.conductor_group         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.connect_retries         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.connect_retry_delay     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.endpoint_override       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.insecure                = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.keyfile                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.max_version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.min_version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.peer_list               = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.region_name             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.serial_console_state_timeout = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.service_name            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.service_type            = baremetal {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.split_loggers           = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.status_code_retries     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.timeout                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ironic.version                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] key_manager.fixed_key          = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.barbican_api_version  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.barbican_endpoint     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.barbican_endpoint_type = public {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.barbican_region_name  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.cafile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.certfile              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.collect_timing        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.insecure              = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.keyfile               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.number_of_retries     = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.retry_delay           = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.send_service_user_token = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.split_loggers         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.timeout               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.verify_ssl            = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican.verify_ssl_path       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.auth_section = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.auth_type = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.cafile   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.certfile = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.collect_timing = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.insecure = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.keyfile  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.split_loggers = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] barbican_service_user.timeout  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.approle_role_id          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.approle_secret_id        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.cafile                   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.certfile                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.collect_timing           = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.insecure                 = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.keyfile                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.kv_mountpoint            = secret {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.kv_path                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.kv_version               = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.namespace                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.root_token_id            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.split_loggers            = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.ssl_ca_crt_file          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.timeout                  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.use_ssl                  = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.auth_section          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.auth_type             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.cafile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.certfile              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.collect_timing        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.connect_retries       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.connect_retry_delay   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.endpoint_override     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.insecure              = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.keyfile               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.max_version           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.min_version           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.region_name           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.service_name          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.service_type          = identity {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.split_loggers         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.status_code_retries   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.timeout               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] keystone.version               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.connection_uri         =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_mode               = custom {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: WARNING oslo_config.cfg [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_power_governor_high = performance {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_power_management   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.device_detach_attempts = 8 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.device_detach_timeout  = 20 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.disk_cachemodes        = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.disk_prefix            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.enabled_perf_events    = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.file_backed_memory     = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.gid_maps               = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.hw_disk_discard        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.hw_machine_type        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_rbd_pool        = rbd {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_type            = default {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.images_volume_group    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.inject_key             = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.inject_partition       = -2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.inject_password        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.iscsi_iface            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.iser_use_multipath     = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_downtime = 500 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_inbound_addr = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_scheme  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_timeout_action = abort {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_tunnelled = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: WARNING oslo_config.cfg [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 18:01:44 user nova-compute[74233]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 18:01:44 user nova-compute[74233]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 18:01:44 user nova-compute[74233]: and ``live_migration_inbound_addr`` respectively.
Oct 20 18:01:44 user nova-compute[74233]: ).  Its value may be silently ignored in the future.
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.live_migration_with_native_tls = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.max_queues             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.nfs_mount_options      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.num_pcie_ports         = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.pmem_namespaces        = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.quobyte_client_cfg     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rbd_secret_uuid        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rbd_user               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rescue_image_id        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rescue_kernel_id       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.rx_queue_size          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.smbfs_mount_options    =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.snapshot_compression   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.snapshot_image_format  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.sparse_logical_volumes = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.swtpm_enabled          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.swtpm_group            = tss {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.swtpm_user             = tss {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.sysinfo_serial         = unique {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.tb_cache_size          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.tx_queue_size          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.uid_maps               = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.use_virtio_for_bridges = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.virt_type              = kvm {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.volume_clear           = zero {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.volume_clear_size      = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.volume_use_multipath   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_cache_path   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.auth_section           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.auth_type              = password {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.cafile                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.certfile               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.collect_timing         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.connect_retries        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.connect_retry_delay    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.default_floating_pool  = public {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.endpoint_override      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.extension_sync_interval = 600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.http_retries           = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.insecure               = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.keyfile                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.max_version            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.min_version            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.ovs_bridge             = br-int {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.physnets               = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.region_name            = RegionOne {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.service_metadata_proxy = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.service_name           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.service_type           = network {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.split_loggers          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.status_code_retries    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.timeout                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] neutron.version                = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] notifications.bdms_in_notifications = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] notifications.default_level    = INFO {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] notifications.notification_format = unversioned {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] notifications.notify_on_state_change = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] pci.alias                      = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] pci.device_spec                = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] pci.report_in_placement        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.auth_section         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.auth_type            = password {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.cafile               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.certfile             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.collect_timing       = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.connect_retries      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.connect_retry_delay  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.default_domain_id    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.default_domain_name  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.domain_id            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.domain_name          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.endpoint_override    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.insecure             = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.keyfile              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.max_version          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.min_version          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.password             = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.project_domain_id    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.project_domain_name  = Default {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.project_id           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.project_name         = service {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.region_name          = RegionOne {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.service_name         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.service_type         = placement {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.split_loggers        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.status_code_retries  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.system_scope         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.timeout              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.trust_id             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.user_domain_id       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.user_domain_name     = Default {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.user_id              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.username             = placement {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] placement.version              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.cores                    = 20 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.count_usage_from_placement = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.injected_file_content_bytes = 10240 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.injected_file_path_length = 255 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.injected_files           = 5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.instances                = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.key_pairs                = 100 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.metadata_items           = 128 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.ram                      = 51200 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.recheck_quota            = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.server_group_members     = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] quota.server_groups            = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rdp.enabled                    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.image_metadata_prefilter = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.max_attempts         = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.max_placement_results = 1000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] scheduler.workers              = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.host_subset_size = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.isolated_hosts = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.isolated_images = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.pci_in_placement = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.track_instance_changes = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metrics.required               = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metrics.weight_multiplier      = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] metrics.weight_setting         = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] serial_console.enabled         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] serial_console.port_range      = 10000:20000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] serial_console.serialproxy_port = 6083 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.auth_section      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.auth_type         = password {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.cafile            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.certfile          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.collect_timing    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.insecure          = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.keyfile           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.send_service_user_token = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.split_loggers     = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] service_user.timeout           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.agent_enabled            = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.enabled                  = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.html5proxy_port          = 6082 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.image_compression        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.jpeg_compression         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.playback_compression     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.server_listen            = 127.0.0.1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.streaming_mode           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] spice.zlib_compression         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] upgrade_levels.baseapi         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] upgrade_levels.cert            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] upgrade_levels.compute         = auto {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] upgrade_levels.conductor       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] upgrade_levels.scheduler       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.cafile = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.certfile = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.insecure = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vendordata_dynamic_auth.timeout = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.api_retry_count         = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.ca_file                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.cache_prefix            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.cluster_name            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.connection_pool_size    = 10 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.console_delay_seconds   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.datastore_regex         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.host_ip                 = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.host_password           = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.host_port               = 443 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.host_username           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.insecure                = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.integration_bridge      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.maximum_objects         = 100 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.pbm_default_policy      = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.pbm_enabled             = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.pbm_wsdl_location       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.serial_port_proxy_uri   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.serial_port_service_uri = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.task_poll_interval      = 0.5 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.use_linked_clone        = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.vnc_keymap              = en-us {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.vnc_port                = 5900 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vmware.vnc_port_total          = 10000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.auth_schemes               = ['none'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.enabled                    = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.novncproxy_port            = 6080 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.vencrypt_ca_certs          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.vencrypt_client_cert       = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vnc.vencrypt_client_key        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.disable_rootwrap   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.enable_numa_live_migration = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.libvirt_disable_apic = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.client_socket_timeout     = 900 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.default_pool_size         = 1000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.keep_alive                = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.max_header_line           = 16384 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.ssl_ca_file               = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.ssl_cert_file             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.ssl_key_file              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.tcp_keepidle              = 600 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] zvm.ca_file                    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] zvm.cloud_connector_url        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] zvm.reachable_timeout          = 300 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.enforce_new_defaults = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.enforce_scope      = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.policy_default_rule = default {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.connection_string     = messaging:// {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.enabled               = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.es_doc_type           = notification {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.es_scroll_size        = 10000 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.es_scroll_time        = 2m {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.filter_error_trace    = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.hmac_keys             = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.sentinel_service_name = mymaster {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.socket_timeout        = 0.1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.trace_requests        = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler.trace_sqlalchemy      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler_jaeger.process_tags   = {} {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler_jaeger.service_name_prefix = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] profiler_otlp.service_name_prefix = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] remote_debug.host              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] remote_debug.port              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_notifications.retry = -1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.auth_section        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.auth_type           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.cafile              = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.certfile            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.collect_timing      = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.connect_retries     = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.connect_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.endpoint_id         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.endpoint_override   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.insecure            = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.keyfile             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.max_version         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.min_version         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.region_name         = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.service_name        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.service_type        = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.split_loggers       = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.status_code_retries = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.status_code_retry_delay = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.timeout             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.valid_interfaces    = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_limit.version             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_reports.file_event_handler = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] oslo_reports.log_dir           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_ovs_privileged.group  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] vif_plug_ovs_privileged.user   = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.isolate_vif         = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] os_brick.lock_path             = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] privsep_osbrick.capabilities   = [21] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] privsep_osbrick.group          = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] privsep_osbrick.helper_command = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] privsep_osbrick.user           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] nova_sys_admin.group           = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] nova_sys_admin.helper_command  = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] nova_sys_admin.user            = None {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG oslo_service.service [None req-cf27837e-bf8a-402b-87a6-06e7c0a3323e None None] ******************************************************************************** {{(pid=74233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 18:01:44 user nova-compute[74233]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Connecting to libvirt: qemu:///system {{(pid=74233) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb981cda4d0> {{(pid=74233) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 18:01:44 user nova-compute[74233]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 18:01:44 user nova-compute[74233]: WARNING nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb981cda4d0> {{(pid=74233) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Starting native event thread {{(pid=74233) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Starting green dispatch thread {{(pid=74233) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Starting connection event dispatch thread {{(pid=74233) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 18:01:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Connection event '1' reason 'None'
Oct 20 18:01:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 18:01:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.mount [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Initialising _HostMountState generation 0 {{(pid=74233) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 18:01:51 user nova-compute[74233]: INFO nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host capabilities <capabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <host>
Oct 20 18:01:51 user nova-compute[74233]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 18:01:51 user nova-compute[74233]:     <cpu>
Oct 20 18:01:51 user nova-compute[74233]:       <arch>x86_64</arch>
Oct 20 18:01:51 user nova-compute[74233]:       <model>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <microcode version='1070'/>
Oct 20 18:01:51 user nova-compute[74233]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='osxsave'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='invtsc'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='rsba'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 18:01:51 user nova-compute[74233]:       <pages unit='KiB' size='4'/>
Oct 20 18:01:51 user nova-compute[74233]:       <pages unit='KiB' size='2048'/>
Oct 20 18:01:51 user nova-compute[74233]:     </cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <power_management>
Oct 20 18:01:51 user nova-compute[74233]:       <suspend_mem/>
Oct 20 18:01:51 user nova-compute[74233]:       <suspend_disk/>
Oct 20 18:01:51 user nova-compute[74233]:       <suspend_hybrid/>
Oct 20 18:01:51 user nova-compute[74233]:     </power_management>
Oct 20 18:01:51 user nova-compute[74233]:     <iommu support='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <migration_features>
Oct 20 18:01:51 user nova-compute[74233]:       <live/>
Oct 20 18:01:51 user nova-compute[74233]:       <uri_transports>
Oct 20 18:01:51 user nova-compute[74233]:         <uri_transport>tcp</uri_transport>
Oct 20 18:01:51 user nova-compute[74233]:         <uri_transport>rdma</uri_transport>
Oct 20 18:01:51 user nova-compute[74233]:       </uri_transports>
Oct 20 18:01:51 user nova-compute[74233]:     </migration_features>
Oct 20 18:01:51 user nova-compute[74233]:     <topology>
Oct 20 18:01:51 user nova-compute[74233]:       <cells num='2'>
Oct 20 18:01:51 user nova-compute[74233]:         <cell id='0'>
Oct 20 18:01:51 user nova-compute[74233]:           <memory unit='KiB'>8140616</memory>
Oct 20 18:01:51 user nova-compute[74233]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 20 18:01:51 user nova-compute[74233]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 18:01:51 user nova-compute[74233]:           <distances>
Oct 20 18:01:51 user nova-compute[74233]:             <sibling id='0' value='10'/>
Oct 20 18:01:51 user nova-compute[74233]:             <sibling id='1' value='20'/>
Oct 20 18:01:51 user nova-compute[74233]:           </distances>
Oct 20 18:01:51 user nova-compute[74233]:           <cpus num='6'>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 18:01:51 user nova-compute[74233]:           </cpus>
Oct 20 18:01:51 user nova-compute[74233]:         </cell>
Oct 20 18:01:51 user nova-compute[74233]:         <cell id='1'>
Oct 20 18:01:51 user nova-compute[74233]:           <memory unit='KiB'>8255068</memory>
Oct 20 18:01:51 user nova-compute[74233]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 20 18:01:51 user nova-compute[74233]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 18:01:51 user nova-compute[74233]:           <distances>
Oct 20 18:01:51 user nova-compute[74233]:             <sibling id='0' value='20'/>
Oct 20 18:01:51 user nova-compute[74233]:             <sibling id='1' value='10'/>
Oct 20 18:01:51 user nova-compute[74233]:           </distances>
Oct 20 18:01:51 user nova-compute[74233]:           <cpus num='6'>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 18:01:51 user nova-compute[74233]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 18:01:51 user nova-compute[74233]:           </cpus>
Oct 20 18:01:51 user nova-compute[74233]:         </cell>
Oct 20 18:01:51 user nova-compute[74233]:       </cells>
Oct 20 18:01:51 user nova-compute[74233]:     </topology>
Oct 20 18:01:51 user nova-compute[74233]:     <cache>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 18:01:51 user nova-compute[74233]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 18:01:51 user nova-compute[74233]:     </cache>
Oct 20 18:01:51 user nova-compute[74233]:     <secmodel>
Oct 20 18:01:51 user nova-compute[74233]:       <model>apparmor</model>
Oct 20 18:01:51 user nova-compute[74233]:       <doi>0</doi>
Oct 20 18:01:51 user nova-compute[74233]:     </secmodel>
Oct 20 18:01:51 user nova-compute[74233]:     <secmodel>
Oct 20 18:01:51 user nova-compute[74233]:       <model>dac</model>
Oct 20 18:01:51 user nova-compute[74233]:       <doi>0</doi>
Oct 20 18:01:51 user nova-compute[74233]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 18:01:51 user nova-compute[74233]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 18:01:51 user nova-compute[74233]:     </secmodel>
Oct 20 18:01:51 user nova-compute[74233]:   </host>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='alpha'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>clipper</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='armv6l'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>spitz</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>nuri</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>kzm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sx1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>z2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>tosa</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>n810</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>n800</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>terrier</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>midway</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>microbit</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>verdex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>highbank</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>akita</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>connex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>collie</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='armv7l'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>spitz</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>nuri</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>kzm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sx1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>z2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>tosa</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>n810</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>n800</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>terrier</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>midway</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>microbit</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>verdex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>highbank</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>akita</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>connex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>collie</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='aarch64'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>spitz</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>nuri</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>kzm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sx1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>z2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>tosa</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>n810</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>n800</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>terrier</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>midway</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>microbit</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>verdex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>highbank</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>akita</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>connex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>collie</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <acpi default='on' toggle='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='cris'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='i686'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>isapc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>microvm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='kvm'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <pae/>
Oct 20 18:01:51 user nova-compute[74233]:       <nonpae/>
Oct 20 18:01:51 user nova-compute[74233]:       <acpi default='on' toggle='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:       <apic default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='m68k'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>an5206</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>q800</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='microblaze'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='microblazeel'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='mips'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='16'>malta</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='mipsel'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='16'>malta</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='mips64'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='16'>malta</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>pica61</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>magnum</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='mips64el'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='16'>malta</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>pica61</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>magnum</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='16'>boston</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='ppc'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mac99</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>40p</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>taihu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='ppc64'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>taihu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>40p</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mac99</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='ppc64le'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>taihu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>40p</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>mac99</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='riscv32'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='8'>spike</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='8'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='riscv64'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='8'>spike</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='8'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='s390x'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='sh4'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>shix</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>r2d</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='sh4eb'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>shix</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>r2d</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='sparc'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>LX</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='sparc64'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>niagara</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='x86_64'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>64</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='1'>isapc</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>microvm</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='kvm'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <acpi default='on' toggle='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:       <apic default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='xtensa'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>sim</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>kc705</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ml605</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx200</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx60</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]:   <guest>
Oct 20 18:01:51 user nova-compute[74233]:     <os_type>hvm</os_type>
Oct 20 18:01:51 user nova-compute[74233]:     <arch name='xtensaeb'>
Oct 20 18:01:51 user nova-compute[74233]:       <wordsize>32</wordsize>
Oct 20 18:01:51 user nova-compute[74233]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='4'>sim</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>kc705</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ml605</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>virt</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx200</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>lx60</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 18:01:51 user nova-compute[74233]:       <domain type='qemu'/>
Oct 20 18:01:51 user nova-compute[74233]:     </arch>
Oct 20 18:01:51 user nova-compute[74233]:     <features>
Oct 20 18:01:51 user nova-compute[74233]:       <cpuselection/>
Oct 20 18:01:51 user nova-compute[74233]:       <deviceboot/>
Oct 20 18:01:51 user nova-compute[74233]:       <disksnapshot default='on' toggle='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     </features>
Oct 20 18:01:51 user nova-compute[74233]:   </guest>
Oct 20 18:01:51 user nova-compute[74233]: </capabilities>
Oct 20 18:01:51 user nova-compute[74233]: 
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-q35-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>i686</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='288'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'/>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='lm'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-q35-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>i686</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='288'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'/>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='lm'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-i440fx-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>i686</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='255'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'/>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='lm'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ide</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-i440fx-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>i686</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='255'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'/>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='lm'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ide</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-q35-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>x86_64</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='288'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>efi</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='invtsc'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='rsba'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-q35-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>x86_64</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='288'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>efi</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='invtsc'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='rsba'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-i440fx-6.2</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>x86_64</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='255'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>efi</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='invtsc'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='rsba'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ide</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 18:01:51 user nova-compute[74233]: <domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 18:01:51 user nova-compute[74233]:   <domain>kvm</domain>
Oct 20 18:01:51 user nova-compute[74233]:   <machine>pc-i440fx-jammy</machine>
Oct 20 18:01:51 user nova-compute[74233]:   <arch>x86_64</arch>
Oct 20 18:01:51 user nova-compute[74233]:   <vcpu max='255'/>
Oct 20 18:01:51 user nova-compute[74233]:   <iothreads supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:   <os supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='firmware'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>efi</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:     <loader supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>rom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pflash</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='readonly'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>yes</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='secure'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>no</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </loader>
Oct 20 18:01:51 user nova-compute[74233]:   </os>
Oct 20 18:01:51 user nova-compute[74233]:   <cpu>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-passthrough' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='hostPassthroughMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='maximum' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='maximumMigratable'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>on</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>off</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='host-model' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <vendor>Intel</vendor>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ss'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='vmx'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pcid'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='hypervisor'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arat'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='umip'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='md-clear'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='invtsc'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibpb'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='ibrs'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-stibp'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='rsba'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='erms'/>
Oct 20 18:01:51 user nova-compute[74233]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:     <mode name='custom' supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>qemu64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>qemu32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>phenom</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>pentium</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>n270</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm64</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>kvm32</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>coreduo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>core2duo</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>athlon</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Westmere</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Snowridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Skylake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>SandyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Penryn</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G5</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G4</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G3</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Opteron_G2</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Opteron_G1</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>IvyBridge</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Icelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Haswell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Rome</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-Milan</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>EPYC</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Dhyana</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cooperlake</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>Conroe</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='no'>Broadwell</model>
Oct 20 18:01:51 user nova-compute[74233]:       <model usable='yes'>486</model>
Oct 20 18:01:51 user nova-compute[74233]:     </mode>
Oct 20 18:01:51 user nova-compute[74233]:   </cpu>
Oct 20 18:01:51 user nova-compute[74233]:   <memoryBacking supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:     <enum name='sourceType'>
Oct 20 18:01:51 user nova-compute[74233]:       <value>file</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>anonymous</value>
Oct 20 18:01:51 user nova-compute[74233]:       <value>memfd</value>
Oct 20 18:01:51 user nova-compute[74233]:     </enum>
Oct 20 18:01:51 user nova-compute[74233]:   </memoryBacking>
Oct 20 18:01:51 user nova-compute[74233]:   <devices>
Oct 20 18:01:51 user nova-compute[74233]:     <disk supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='diskDevice'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>disk</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cdrom</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>floppy</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>lun</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='bus'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ide</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>fdc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sata</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </disk>
Oct 20 18:01:51 user nova-compute[74233]:     <graphics supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='type'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>sdl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vnc</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>spice</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egl-headless</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </graphics>
Oct 20 18:01:51 user nova-compute[74233]:     <video supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='modelType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>cirrus</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>vmvga</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>qxl</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>none</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>bochs</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>ramfb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </video>
Oct 20 18:01:51 user nova-compute[74233]:     <hostdev supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='mode'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>subsystem</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='startupPolicy'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>default</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>mandatory</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>requisite</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>optional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='subsysType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>usb</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>pci</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>scsi</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='capsType'/>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='pciBackend'/>
Oct 20 18:01:51 user nova-compute[74233]:     </hostdev>
Oct 20 18:01:51 user nova-compute[74233]:     <rng supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtio-non-transitional</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>random</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>egd</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>builtin</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </rng>
Oct 20 18:01:51 user nova-compute[74233]:     <filesystem supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='driverType'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>path</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>handle</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>virtiofs</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </filesystem>
Oct 20 18:01:51 user nova-compute[74233]:     <tpm supported='yes'>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='model'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-tis</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>tpm-crb</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:       <enum name='backendModel'>
Oct 20 18:01:51 user nova-compute[74233]:         <value>passthrough</value>
Oct 20 18:01:51 user nova-compute[74233]:         <value>emulator</value>
Oct 20 18:01:51 user nova-compute[74233]:       </enum>
Oct 20 18:01:51 user nova-compute[74233]:     </tpm>
Oct 20 18:01:51 user nova-compute[74233]:   </devices>
Oct 20 18:01:51 user nova-compute[74233]:   <features>
Oct 20 18:01:51 user nova-compute[74233]:     <gic supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:     <vmcoreinfo supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <genid supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backingStoreInput supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <backup supported='yes'/>
Oct 20 18:01:51 user nova-compute[74233]:     <sev supported='no'/>
Oct 20 18:01:51 user nova-compute[74233]:   </features>
Oct 20 18:01:51 user nova-compute[74233]: </domainCapabilities>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Checking secure boot support for host arch (x86_64) {{(pid=74233) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 18:01:51 user nova-compute[74233]: INFO nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Secure Boot support detected
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] cpu compare xml: <cpu match="exact">
Oct 20 18:01:51 user nova-compute[74233]:   <model>Nehalem</model>
Oct 20 18:01:51 user nova-compute[74233]: </cpu>
Oct 20 18:01:51 user nova-compute[74233]:  {{(pid=74233) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 18:01:51 user nova-compute[74233]: INFO nova.virt.node [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Generated node identity cc4059c5-9fe5-4cfa-b006-c468906869b2
Oct 20 18:01:51 user nova-compute[74233]: INFO nova.virt.node [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Wrote node identity cc4059c5-9fe5-4cfa-b006-c468906869b2 to /opt/stack/data/nova/compute_id
Oct 20 18:01:51 user nova-compute[74233]: WARNING nova.compute.manager [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Compute nodes ['cc4059c5-9fe5-4cfa-b006-c468906869b2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 18:01:51 user nova-compute[74233]: INFO nova.compute.manager [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 18:01:51 user nova-compute[74233]: WARNING nova.compute.manager [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 18:01:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:01:51 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:01:51 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:01:51 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Hypervisor/Node resource view: name=user free_ram=10997MB free_disk=26.15178680419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:01:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:01:51 user nova-compute[74233]: WARNING nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] No compute node record for user:cc4059c5-9fe5-4cfa-b006-c468906869b2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cc4059c5-9fe5-4cfa-b006-c468906869b2 could not be found.
Oct 20 18:01:52 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Compute node record created for user:user with uuid: cc4059c5-9fe5-4cfa-b006-c468906869b2
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:01:52 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] [req-0106d836-b2fe-42f0-a494-f4d2dfff9e26] Created resource provider record via placement API for resource provider with UUID cc4059c5-9fe5-4cfa-b006-c468906869b2 and name user.
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74233) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 18:01:52 user nova-compute[74233]: INFO nova.virt.libvirt.host [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] kernel doesn't support AMD SEV
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Libvirt baseline CPU <cpu>
Oct 20 18:01:52 user nova-compute[74233]:   <arch>x86_64</arch>
Oct 20 18:01:52 user nova-compute[74233]:   <model>Nehalem</model>
Oct 20 18:01:52 user nova-compute[74233]:   <vendor>Intel</vendor>
Oct 20 18:01:52 user nova-compute[74233]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 18:01:52 user nova-compute[74233]: </cpu>
Oct 20 18:01:52 user nova-compute[74233]:  {{(pid=74233) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Updated inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Updating resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 generation from 0 to 1 during operation: update_inventory {{(pid=74233) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Updating resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 generation from 1 to 2 during operation: update_traits {{(pid=74233) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.service [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Creating RPC server for service compute {{(pid=74233) start /opt/stack/nova/nova/service.py:182}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.service [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] Join ServiceGroup membership for this service compute {{(pid=74233) start /opt/stack/nova/nova/service.py:199}}
Oct 20 18:01:52 user nova-compute[74233]: DEBUG nova.servicegroup.drivers.db [None req-7c2bc2b8-86f6-4621-9ed6-7df0d6042c59 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74233) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:02:52 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:02:52 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:02:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=10402MB free_disk=26.055400848388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:02:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:02:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:03:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:03:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=10345MB free_disk=26.120159149169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:03:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:03:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:03:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:04:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:04:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:04:43 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:04:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:04:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:04:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=10351MB free_disk=25.87549591064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:04:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:04:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:04:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:44 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:05:45 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:05:45 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:05:45 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9627MB free_disk=25.893402099609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:05:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:05:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:05:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:05:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:05:54 user nova-compute[74233]: INFO nova.compute.claims [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Claim successful on node user
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:05:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:05:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Creating image(s)
Oct 20 18:05:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "/opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "/opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "/opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:55 user nova-compute[74233]: DEBUG nova.policy [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '693eb6d3b55d4934bdc51bd28d95f8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c6c41b354479bbb30d00217081fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.part --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG nova.virt.images [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] eaa6d842-3abb-4a80-92cd-b9a50e121c9f was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.part /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:56 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.part /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.converted" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:05:57 user nova-compute[74233]: INFO nova.compute.claims [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Claim successful on node user
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.525s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:57 user nova-compute[74233]: INFO oslo.privsep.daemon [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpypnhkmzx/privsep.sock']
Oct 20 18:05:57 user sudo[83492]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpypnhkmzx/privsep.sock
Oct 20 18:05:57 user sudo[83492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:05:57 user nova-compute[74233]: INFO nova.compute.claims [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Claim successful on node user
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.network.neutron [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Successfully created port: 03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:05:57 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:05:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.policy [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5149d5d6d1f486c87a0c808597a40f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c937ee3474848de8b761d88e32f6447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:05:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Creating image(s)
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "/opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:05:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.policy [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74c1e18569184b7ca8ce578e5e24bfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5f6324b8b44903af56785a67af93d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:05:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Creating image(s)
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "/opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "/opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:58 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:05:58 user nova-compute[74233]: INFO nova.compute.claims [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Claim successful on node user
Oct 20 18:05:58 user sudo[83492]: pam_unix(sudo:session): session closed for user root
Oct 20 18:05:58 user nova-compute[74233]: INFO oslo.privsep.daemon [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Spawned new privsep daemon via rootwrap
Oct 20 18:05:58 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 18:05:58 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 18:05:58 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 18:05:58 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83495
Oct 20 18:05:58 user nova-compute[74233]: WARNING oslo_privsep.priv_context [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] privsep daemon already running
Oct 20 18:05:58 user nova-compute[74233]: WARNING oslo_privsep.priv_context [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] privsep daemon already running
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.214s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Successfully created port: af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.244s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.225s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:05:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk 1073741824" returned: 0 in 0.068s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.251s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.policy [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5880cc8b27b4906a89d92f4fc4c2d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4438cc27f48243beacf618702f82de4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:05:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Creating image(s)
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.216s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Successfully updated port: 03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.227s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquired lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk 1073741824" returned: 0 in 0.055s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.583s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:05:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.275s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Cannot resize image /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Ensure instance console log exists: /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.259s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.239s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-changed-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Refreshing instance network info cache due to event network-changed-03d38729-8f95-4ab2-b711-934597b6a333. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] Acquiring lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk 1073741824" returned: 0 in 0.047s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.265s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Cannot resize image /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Ensure instance console log exists: /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.165s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.207s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk 1073741824" returned: 0 in 0.055s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Cannot resize image /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Ensure instance console log exists: /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Successfully created port: b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Cannot resize image /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Ensure instance console log exists: /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updating instance_info_cache with network_info: [{"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Releasing lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Instance network_info: |[{"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] Acquired lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Refreshing network info cache for port 03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Start _get_guest_xml network_info=[{"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1773192317',display_name='tempest-DeleteServersTestJSON-server-1773192317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1773192317',id=1,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='088c6c41b354479bbb30d00217081fae',ramdisk_id='',reservation_id='r-0ep7uvo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1800105009',owner_user_name='tempest-DeleteServersTestJSON-1800105009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:05:56Z,user_data=None,user_id='693eb6d3b55d4934bdc51bd28d95f8e9',uuid=52047bb0-5fcf-4de4-851d-c3526ae9ecf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Converting VIF {"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lazy-loading 'pci_devices' on Instance uuid 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:01 user nova-compute[74233]:   <uuid>52047bb0-5fcf-4de4-851d-c3526ae9ecf9</uuid>
Oct 20 18:06:01 user nova-compute[74233]:   <name>instance-00000001</name>
Oct 20 18:06:01 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:01 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:01 user nova-compute[74233]:   <metadata>
Oct 20 18:06:01 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:01 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:01 user nova-compute[74233]:       <nova:name>tempest-DeleteServersTestJSON-server-1773192317</nova:name>
Oct 20 18:06:01 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:01</nova:creationTime>
Oct 20 18:06:01 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:01 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:01 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:01 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:user uuid="693eb6d3b55d4934bdc51bd28d95f8e9">tempest-DeleteServersTestJSON-1800105009-project-member</nova:user>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:project uuid="088c6c41b354479bbb30d00217081fae">tempest-DeleteServersTestJSON-1800105009</nova:project>
Oct 20 18:06:01 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:01 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:01 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:01 user nova-compute[74233]:         <nova:port uuid="03d38729-8f95-4ab2-b711-934597b6a333">
Oct 20 18:06:01 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 18:06:01 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:01 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:01 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:01 user nova-compute[74233]:   </metadata>
Oct 20 18:06:01 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:01 user nova-compute[74233]:     <system>
Oct 20 18:06:01 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:01 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:01 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:01 user nova-compute[74233]:       <entry name="serial">52047bb0-5fcf-4de4-851d-c3526ae9ecf9</entry>
Oct 20 18:06:01 user nova-compute[74233]:       <entry name="uuid">52047bb0-5fcf-4de4-851d-c3526ae9ecf9</entry>
Oct 20 18:06:01 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:01 user nova-compute[74233]:     </system>
Oct 20 18:06:01 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:01 user nova-compute[74233]:   <os>
Oct 20 18:06:01 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:01 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:01 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:01 user nova-compute[74233]:   </os>
Oct 20 18:06:01 user nova-compute[74233]:   <features>
Oct 20 18:06:01 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:01 user nova-compute[74233]:     <apic/>
Oct 20 18:06:01 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:01 user nova-compute[74233]:   </features>
Oct 20 18:06:01 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:01 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:01 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:01 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:01 user nova-compute[74233]:   </clock>
Oct 20 18:06:01 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:01 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:01 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:01 user nova-compute[74233]:   </cpu>
Oct 20 18:06:01 user nova-compute[74233]:   <devices>
Oct 20 18:06:01 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:01 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:01 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk"/>
Oct 20 18:06:01 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:01 user nova-compute[74233]:     </disk>
Oct 20 18:06:01 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:01 user nova-compute[74233]:       <mac address="fa:16:3e:aa:30:c4"/>
Oct 20 18:06:01 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:01 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:01 user nova-compute[74233]:       <target dev="tap03d38729-8f"/>
Oct 20 18:06:01 user nova-compute[74233]:     </interface>
Oct 20 18:06:01 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:01 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/console.log" append="off"/>
Oct 20 18:06:01 user nova-compute[74233]:     </serial>
Oct 20 18:06:01 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:01 user nova-compute[74233]:     <video>
Oct 20 18:06:01 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:01 user nova-compute[74233]:     </video>
Oct 20 18:06:01 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:01 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:01 user nova-compute[74233]:     </rng>
Oct 20 18:06:01 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:01 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:01 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:01 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:01 user nova-compute[74233]:   </devices>
Oct 20 18:06:01 user nova-compute[74233]: </domain>
Oct 20 18:06:01 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1773192317',display_name='tempest-DeleteServersTestJSON-server-1773192317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1773192317',id=1,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='088c6c41b354479bbb30d00217081fae',ramdisk_id='',reservation_id='r-0ep7uvo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1800105009',owner_user_name='tempest-DeleteServersTestJSON-1800105009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:05:56Z,user_data=None,user_id='693eb6d3b55d4934bdc51bd28d95f8e9',uuid=52047bb0-5fcf-4de4-851d-c3526ae9ecf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Converting VIF {"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG os_vif [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Created schema index Interface.name {{(pid=74233) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Created schema index Port.name {{(pid=74233) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Created schema index Bridge.name {{(pid=74233) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [POLLOUT] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a2537f1-5ef1-5960-a5fc-6f9379217850', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:01 user nova-compute[74233]: INFO oslo.privsep.daemon [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkdfi66cz/privsep.sock']
Oct 20 18:06:01 user sudo[83565]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkdfi66cz/privsep.sock
Oct 20 18:06:01 user sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Successfully updated port: af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-changed-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Refreshing instance network info cache due to event network-changed-af2e219f-81be-4408-8b13-f318d6ed98a3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] Acquiring lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Successfully created port: 7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updated VIF entry in instance network info cache for port 03d38729-8f95-4ab2-b711-934597b6a333. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updating instance_info_cache with network_info: [{"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae32847f-5dff-4269-97e3-51e24af7d644 req-a502eddd-f172-4179-a35d-eac754d6a156 service nova] Releasing lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Successfully updated port: b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquired lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Instance network_info: |[{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] Acquired lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Refreshing network info cache for port af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Start _get_guest_xml network_info=[{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980793586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980793586',id=2,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-5ou4bmg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:05:58Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=538cde40-8a87-4837-9b1e-05a4c60659fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.objects.instance [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'pci_devices' on Instance uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:02 user nova-compute[74233]:   <uuid>538cde40-8a87-4837-9b1e-05a4c60659fb</uuid>
Oct 20 18:06:02 user nova-compute[74233]:   <name>instance-00000002</name>
Oct 20 18:06:02 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:02 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:02 user nova-compute[74233]:   <metadata>
Oct 20 18:06:02 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:02 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:02 user nova-compute[74233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-980793586</nova:name>
Oct 20 18:06:02 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:02</nova:creationTime>
Oct 20 18:06:02 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:02 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:02 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:02 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:user uuid="a5149d5d6d1f486c87a0c808597a40f3">tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member</nova:user>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:project uuid="8c937ee3474848de8b761d88e32f6447">tempest-ServerBootFromVolumeStableRescueTest-481267461</nova:project>
Oct 20 18:06:02 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:02 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:02 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:02 user nova-compute[74233]:         <nova:port uuid="af2e219f-81be-4408-8b13-f318d6ed98a3">
Oct 20 18:06:02 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:06:02 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:02 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:02 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:02 user nova-compute[74233]:   </metadata>
Oct 20 18:06:02 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:02 user nova-compute[74233]:     <system>
Oct 20 18:06:02 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:02 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:02 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:02 user nova-compute[74233]:       <entry name="serial">538cde40-8a87-4837-9b1e-05a4c60659fb</entry>
Oct 20 18:06:02 user nova-compute[74233]:       <entry name="uuid">538cde40-8a87-4837-9b1e-05a4c60659fb</entry>
Oct 20 18:06:02 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:02 user nova-compute[74233]:     </system>
Oct 20 18:06:02 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:02 user nova-compute[74233]:   <os>
Oct 20 18:06:02 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:02 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:02 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:02 user nova-compute[74233]:   </os>
Oct 20 18:06:02 user nova-compute[74233]:   <features>
Oct 20 18:06:02 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:02 user nova-compute[74233]:     <apic/>
Oct 20 18:06:02 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:02 user nova-compute[74233]:   </features>
Oct 20 18:06:02 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:02 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:02 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:02 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:02 user nova-compute[74233]:   </clock>
Oct 20 18:06:02 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:02 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:02 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:02 user nova-compute[74233]:   </cpu>
Oct 20 18:06:02 user nova-compute[74233]:   <devices>
Oct 20 18:06:02 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:02 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:02 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk"/>
Oct 20 18:06:02 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:02 user nova-compute[74233]:     </disk>
Oct 20 18:06:02 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:02 user nova-compute[74233]:       <mac address="fa:16:3e:62:e7:2f"/>
Oct 20 18:06:02 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:02 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:02 user nova-compute[74233]:       <target dev="tapaf2e219f-81"/>
Oct 20 18:06:02 user nova-compute[74233]:     </interface>
Oct 20 18:06:02 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:02 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/console.log" append="off"/>
Oct 20 18:06:02 user nova-compute[74233]:     </serial>
Oct 20 18:06:02 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:02 user nova-compute[74233]:     <video>
Oct 20 18:06:02 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:02 user nova-compute[74233]:     </video>
Oct 20 18:06:02 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:02 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:02 user nova-compute[74233]:     </rng>
Oct 20 18:06:02 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:02 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:02 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:02 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:02 user nova-compute[74233]:   </devices>
Oct 20 18:06:02 user nova-compute[74233]: </domain>
Oct 20 18:06:02 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:02 user sudo[83565]: pam_unix(sudo:session): session closed for user root
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980793586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980793586',id=2,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-5ou4bmg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:05:58Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=538cde40-8a87-4837-9b1e-05a4c60659fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG os_vif [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf9686a0-9c07-5a15-a7e2-8ed653f9c1ab', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:02 user nova-compute[74233]: INFO oslo.privsep.daemon [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Spawned new privsep daemon via rootwrap
Oct 20 18:06:02 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 18:06:02 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 18:06:02 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 18:06:02 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83568
Oct 20 18:06:03 user nova-compute[74233]: WARNING oslo_privsep.priv_context [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] privsep daemon already running
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-changed-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Refreshing instance network info cache due to event network-changed-b5309b28-7869-4a97-9e33-baf666deb08a. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] Acquiring lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf2e219f-81, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf2e219f-81, col_values=(('qos', UUID('6fbcedd6-81b8-4f65-9358-8ad4e06c7984')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf2e219f-81, col_values=(('external_ids', {'iface-id': 'af2e219f-81be-4408-8b13-f318d6ed98a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:e7:2f', 'vm-uuid': '538cde40-8a87-4837-9b1e-05a4c60659fb'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: INFO os_vif [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81')
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03d38729-8f, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03d38729-8f, col_values=(('qos', UUID('0f87076e-095a-4ac9-9e76-1415c8359c8d')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03d38729-8f, col_values=(('external_ids', {'iface-id': '03d38729-8f95-4ab2-b711-934597b6a333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:30:c4', 'vm-uuid': '52047bb0-5fcf-4de4-851d-c3526ae9ecf9'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: INFO os_vif [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f')
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updating instance_info_cache with network_info: [{"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Releasing lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Instance network_info: |[{"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] Acquired lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Refreshing network info cache for port b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Start _get_guest_xml network_info=[{"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No VIF found with MAC fa:16:3e:62:e7:2f, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] No VIF found with MAC fa:16:3e:aa:30:c4, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173060278',display_name='tempest-AttachVolumeTestJSON-server-1173060278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173060278',id=3,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk0Dmh+OiRtyCxK3x0h+w/wmvMgbfvsUYfdm0YStx4PwucG182aDbbsLUgRpCVRieyntRX6r32P9BA2oZKvrdRe0naKzuiKFaAgF3u/Z2N+YSs6gdXkS4cbCg6z6zhWeg==',key_name='tempest-keypair-272701511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e5f6324b8b44903af56785a67af93d9',ramdisk_id='',reservation_id='r-fk6pz4az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1002715263',owner_user_name='tempest-AttachVolumeTestJSON-1002715263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c1e18569184b7ca8ce578e5e24bfc6',uuid=1d5ccae4-54fb-4831-bd8a-dce5fc1ef936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converting VIF {"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:03 user nova-compute[74233]:   <uuid>1d5ccae4-54fb-4831-bd8a-dce5fc1ef936</uuid>
Oct 20 18:06:03 user nova-compute[74233]:   <name>instance-00000003</name>
Oct 20 18:06:03 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:03 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:03 user nova-compute[74233]:   <metadata>
Oct 20 18:06:03 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:03 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:03 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeTestJSON-server-1173060278</nova:name>
Oct 20 18:06:03 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:03</nova:creationTime>
Oct 20 18:06:03 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:03 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:03 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:03 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:user uuid="74c1e18569184b7ca8ce578e5e24bfc6">tempest-AttachVolumeTestJSON-1002715263-project-member</nova:user>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:project uuid="7e5f6324b8b44903af56785a67af93d9">tempest-AttachVolumeTestJSON-1002715263</nova:project>
Oct 20 18:06:03 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:03 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:03 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:03 user nova-compute[74233]:         <nova:port uuid="b5309b28-7869-4a97-9e33-baf666deb08a">
Oct 20 18:06:03 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 18:06:03 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:03 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:03 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:03 user nova-compute[74233]:   </metadata>
Oct 20 18:06:03 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:03 user nova-compute[74233]:     <system>
Oct 20 18:06:03 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:03 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:03 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:03 user nova-compute[74233]:       <entry name="serial">1d5ccae4-54fb-4831-bd8a-dce5fc1ef936</entry>
Oct 20 18:06:03 user nova-compute[74233]:       <entry name="uuid">1d5ccae4-54fb-4831-bd8a-dce5fc1ef936</entry>
Oct 20 18:06:03 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:03 user nova-compute[74233]:     </system>
Oct 20 18:06:03 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:03 user nova-compute[74233]:   <os>
Oct 20 18:06:03 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:03 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:03 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:03 user nova-compute[74233]:   </os>
Oct 20 18:06:03 user nova-compute[74233]:   <features>
Oct 20 18:06:03 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:03 user nova-compute[74233]:     <apic/>
Oct 20 18:06:03 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:03 user nova-compute[74233]:   </features>
Oct 20 18:06:03 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:03 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:03 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:03 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:03 user nova-compute[74233]:   </clock>
Oct 20 18:06:03 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:03 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:03 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:03 user nova-compute[74233]:   </cpu>
Oct 20 18:06:03 user nova-compute[74233]:   <devices>
Oct 20 18:06:03 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:03 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:03 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk"/>
Oct 20 18:06:03 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:03 user nova-compute[74233]:     </disk>
Oct 20 18:06:03 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:03 user nova-compute[74233]:       <mac address="fa:16:3e:21:32:9c"/>
Oct 20 18:06:03 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:03 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:03 user nova-compute[74233]:       <target dev="tapb5309b28-78"/>
Oct 20 18:06:03 user nova-compute[74233]:     </interface>
Oct 20 18:06:03 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:03 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/console.log" append="off"/>
Oct 20 18:06:03 user nova-compute[74233]:     </serial>
Oct 20 18:06:03 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:03 user nova-compute[74233]:     <video>
Oct 20 18:06:03 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:03 user nova-compute[74233]:     </video>
Oct 20 18:06:03 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:03 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:03 user nova-compute[74233]:     </rng>
Oct 20 18:06:03 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:03 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:03 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:03 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:03 user nova-compute[74233]:   </devices>
Oct 20 18:06:03 user nova-compute[74233]: </domain>
Oct 20 18:06:03 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173060278',display_name='tempest-AttachVolumeTestJSON-server-1173060278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173060278',id=3,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk0Dmh+OiRtyCxK3x0h+w/wmvMgbfvsUYfdm0YStx4PwucG182aDbbsLUgRpCVRieyntRX6r32P9BA2oZKvrdRe0naKzuiKFaAgF3u/Z2N+YSs6gdXkS4cbCg6z6zhWeg==',key_name='tempest-keypair-272701511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e5f6324b8b44903af56785a67af93d9',ramdisk_id='',reservation_id='r-fk6pz4az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1002715263',owner_user_name='tempest-AttachVolumeTestJSON-1002715263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c1e18569184b7ca8ce578e5e24bfc6',uuid=1d5ccae4-54fb-4831-bd8a-dce5fc1ef936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converting VIF {"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG os_vif [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9bdb049-92ef-5a9c-be8b-3da4664119e0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5309b28-78, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5309b28-78, col_values=(('qos', UUID('cef8f0dc-5b94-4f04-905b-37d0043763e4')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5309b28-78, col_values=(('external_ids', {'iface-id': 'b5309b28-7869-4a97-9e33-baf666deb08a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:32:9c', 'vm-uuid': '1d5ccae4-54fb-4831-bd8a-dce5fc1ef936'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:03 user nova-compute[74233]: INFO os_vif [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78')
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No VIF found with MAC fa:16:3e:21:32:9c, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updated VIF entry in instance network info cache for port af2e219f-81be-4408-8b13-f318d6ed98a3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b1d2e9c3-1af1-4cf6-ae2b-28620a62fb0a req-fa6d0096-f817-4f7e-ac9b-0ca8efad8124 service nova] Releasing lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Successfully updated port: 7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing instance network info cache due to event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updated VIF entry in instance network info cache for port b5309b28-7869-4a97-9e33-baf666deb08a. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updating instance_info_cache with network_info: [{"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8cded4bc-3bd2-409b-89ac-f3245e3a42e3 req-9c734337-3880-48bc-9bba-47ec73666932 service nova] Releasing lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance network_info: |[{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Start _get_guest_xml network_info=[{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1799510366',display_name='tempest-ServerStableDeviceRescueTest-server-1799510366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1799510366',id=4,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWAzatv9vgWsTaQRaMw733k1HcQFUPs/2CdZmpTrrnaVx5jCahzct2xVjsdAoOw923F+CvNnKuXVCic8N+GGORLyN22CLzYBi6Iqg7X9YSJ6YDZTQhz9DsFEfeoo9ysAg==',key_name='tempest-keypair-1389511728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4438cc27f48243beacf618702f82de4b',ramdisk_id='',reservation_id='r-df0slk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2000827243',owner_user_name='tempest-ServerStableDeviceRescueTest-2000827243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5880cc8b27b4906a89d92f4fc4c2d05',uuid=787cb236-6ef6-4366-a564-9d85d17914f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converting VIF {"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'pci_devices' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:05 user nova-compute[74233]:   <uuid>787cb236-6ef6-4366-a564-9d85d17914f0</uuid>
Oct 20 18:06:05 user nova-compute[74233]:   <name>instance-00000004</name>
Oct 20 18:06:05 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:05 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:05 user nova-compute[74233]:   <metadata>
Oct 20 18:06:05 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:05 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:05 user nova-compute[74233]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1799510366</nova:name>
Oct 20 18:06:05 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:05</nova:creationTime>
Oct 20 18:06:05 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:05 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:05 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:05 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:user uuid="a5880cc8b27b4906a89d92f4fc4c2d05">tempest-ServerStableDeviceRescueTest-2000827243-project-member</nova:user>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:project uuid="4438cc27f48243beacf618702f82de4b">tempest-ServerStableDeviceRescueTest-2000827243</nova:project>
Oct 20 18:06:05 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:05 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:05 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:05 user nova-compute[74233]:         <nova:port uuid="7371e3fd-09e0-43d8-8468-61178a7cffc4">
Oct 20 18:06:05 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:06:05 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:05 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:05 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:05 user nova-compute[74233]:   </metadata>
Oct 20 18:06:05 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:05 user nova-compute[74233]:     <system>
Oct 20 18:06:05 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:05 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:05 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:05 user nova-compute[74233]:       <entry name="serial">787cb236-6ef6-4366-a564-9d85d17914f0</entry>
Oct 20 18:06:05 user nova-compute[74233]:       <entry name="uuid">787cb236-6ef6-4366-a564-9d85d17914f0</entry>
Oct 20 18:06:05 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:05 user nova-compute[74233]:     </system>
Oct 20 18:06:05 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:05 user nova-compute[74233]:   <os>
Oct 20 18:06:05 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:05 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:05 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:05 user nova-compute[74233]:   </os>
Oct 20 18:06:05 user nova-compute[74233]:   <features>
Oct 20 18:06:05 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:05 user nova-compute[74233]:     <apic/>
Oct 20 18:06:05 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:05 user nova-compute[74233]:   </features>
Oct 20 18:06:05 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:05 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:05 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:05 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:05 user nova-compute[74233]:   </clock>
Oct 20 18:06:05 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:05 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:05 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:05 user nova-compute[74233]:   </cpu>
Oct 20 18:06:05 user nova-compute[74233]:   <devices>
Oct 20 18:06:05 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:05 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:05 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk"/>
Oct 20 18:06:05 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:05 user nova-compute[74233]:     </disk>
Oct 20 18:06:05 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:05 user nova-compute[74233]:       <mac address="fa:16:3e:8e:7e:86"/>
Oct 20 18:06:05 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:05 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:05 user nova-compute[74233]:       <target dev="tap7371e3fd-09"/>
Oct 20 18:06:05 user nova-compute[74233]:     </interface>
Oct 20 18:06:05 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:05 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/console.log" append="off"/>
Oct 20 18:06:05 user nova-compute[74233]:     </serial>
Oct 20 18:06:05 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:05 user nova-compute[74233]:     <video>
Oct 20 18:06:05 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:05 user nova-compute[74233]:     </video>
Oct 20 18:06:05 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:05 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:05 user nova-compute[74233]:     </rng>
Oct 20 18:06:05 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:05 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:05 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:05 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:05 user nova-compute[74233]:   </devices>
Oct 20 18:06:05 user nova-compute[74233]: </domain>
Oct 20 18:06:05 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1799510366',display_name='tempest-ServerStableDeviceRescueTest-server-1799510366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1799510366',id=4,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWAzatv9vgWsTaQRaMw733k1HcQFUPs/2CdZmpTrrnaVx5jCahzct2xVjsdAoOw923F+CvNnKuXVCic8N+GGORLyN22CLzYBi6Iqg7X9YSJ6YDZTQhz9DsFEfeoo9ysAg==',key_name='tempest-keypair-1389511728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4438cc27f48243beacf618702f82de4b',ramdisk_id='',reservation_id='r-df0slk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2000827243',owner_user_name='tempest-ServerStableDeviceRescueTest-2000827243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5880cc8b27b4906a89d92f4fc4c2d05',uuid=787cb236-6ef6-4366-a564-9d85d17914f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converting VIF {"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG os_vif [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52373601-e3e8-595c-b143-05c6adc741ec', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7371e3fd-09, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7371e3fd-09, col_values=(('qos', UUID('e46641ca-86ca-4ce3-9e9b-1e8002bb7815')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7371e3fd-09, col_values=(('external_ids', {'iface-id': '7371e3fd-09e0-43d8-8468-61178a7cffc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:7e:86', 'vm-uuid': '787cb236-6ef6-4366-a564-9d85d17914f0'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:05 user nova-compute[74233]: INFO os_vif [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09')
Oct 20 18:06:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No VIF found with MAC fa:16:3e:8e:7e:86, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updated VIF entry in instance network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-903d271b-154c-464e-b4d1-26252d939718 req-4839c06b-26bd-402b-8513-ebc33b7cdfc3 service nova] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-646c6dc5-0e7f-461c-98ad-5c9b68cdf6ea req-df3d6064-fead-4850-8227-bbdd29d8aad8 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-646c6dc5-0e7f-461c-98ad-5c9b68cdf6ea req-df3d6064-fead-4850-8227-bbdd29d8aad8 service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-646c6dc5-0e7f-461c-98ad-5c9b68cdf6ea req-df3d6064-fead-4850-8227-bbdd29d8aad8 service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-646c6dc5-0e7f-461c-98ad-5c9b68cdf6ea req-df3d6064-fead-4850-8227-bbdd29d8aad8 service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-646c6dc5-0e7f-461c-98ad-5c9b68cdf6ea req-df3d6064-fead-4850-8227-bbdd29d8aad8 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:10 user nova-compute[74233]: WARNING nova.compute.manager [req-646c6dc5-0e7f-461c-98ad-5c9b68cdf6ea req-df3d6064-fead-4850-8227-bbdd29d8aad8 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state building and task_state spawning.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Instance spawned successfully.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: INFO nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Took 13.36 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Instance spawned successfully.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:11 user nova-compute[74233]: INFO nova.compute.manager [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Took 14.60 seconds to build instance.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-511f2dd6-37e2-43d0-a4b1-ffbb9ada1c23 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.856s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:11 user nova-compute[74233]: INFO nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Took 13.12 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:11 user nova-compute[74233]: INFO nova.compute.manager [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Took 14.18 seconds to build instance.
Oct 20 18:06:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb4a79ae-7518-4c5c-a5de-34032dfcc951 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.362s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance spawned successfully.
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Instance spawned successfully.
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:12 user nova-compute[74233]: INFO nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Took 12.69 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:12 user nova-compute[74233]: INFO nova.compute.manager [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Took 14.08 seconds to build instance.
Oct 20 18:06:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:06:12 user nova-compute[74233]: INFO nova.compute.claims [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Claim successful on node user
Oct 20 18:06:12 user nova-compute[74233]: INFO nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Took 16.98 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65e41374-dd67-476d-ac1a-06912a75b7f4 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.467s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:13 user nova-compute[74233]: WARNING nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state active and task_state None.
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] No waiting events found dispatching network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:13 user nova-compute[74233]: WARNING nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received unexpected event network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 for instance with vm_state building and task_state spawning.
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] No waiting events found dispatching network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:13 user nova-compute[74233]: WARNING nova.compute.manager [req-9fdbfb1c-8994-478f-8133-88bad1f60434 req-eb672d63-743d-48a3-b55d-eeb230aeee4f service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received unexpected event network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 for instance with vm_state building and task_state spawning.
Oct 20 18:06:13 user nova-compute[74233]: INFO nova.compute.manager [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Took 18.61 seconds to build instance.
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9dd589b1-8e90-45a1-b074-c24419b11cdc tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.874s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.870s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:06:13 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.policy [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4c6280b548459599c60b88672a963c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2110b7ff17d146d1b97f0daea38053f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:06:13 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Creating image(s)
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "/opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "/opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "/opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.281s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk 1073741824" returned: 0 in 0.090s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:06:14 user nova-compute[74233]: INFO nova.compute.claims [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Claim successful on node user
Oct 20 18:06:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.256s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Cannot resize image /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Ensure instance console log exists: /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:06:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.policy [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '492278c0179f4b3592128bf856a8c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89381edff924c5fa093f25e2e2d371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:06:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Creating image(s)
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "/opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "/opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "/opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Successfully created port: bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:06:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.part --force-share --output=json" returned: 0 in 0.282s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG nova.virt.images [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] c792114a-c399-4789-9f03-1112e46d2c68 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.part /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:16 user nova-compute[74233]: DEBUG nova.network.neutron [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Successfully created port: e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.part /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.converted" returned: 0 in 0.260s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26.converted --force-share --output=json" returned: 0 in 0.284s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.597s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 --force-share --output=json" returned: 0 in 0.320s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 --force-share --output=json" returned: 0 in 0.280s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26,backing_fmt=raw /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26,backing_fmt=raw /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk 1073741824" returned: 0 in 0.065s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 --force-share --output=json" returned: 0 in 0.251s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Successfully updated port: e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Cannot resize image /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Ensure instance console log exists: /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquired lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-changed-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Refreshing instance network info cache due to event network-changed-e61a576f-6bea-40a1-9968-12245073e169. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] Acquiring lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Successfully updated port: bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquired lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-changed-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Refreshing instance network info cache due to event network-changed-bf24bab0-51aa-4996-b37d-df67798591c3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] Acquiring lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updating instance_info_cache with network_info: [{"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Releasing lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Instance network_info: |[{"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] Acquired lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Refreshing network info cache for port e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Start _get_guest_xml network_info=[{"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:06:07Z,direct_url=<?>,disk_format='qcow2',id=c792114a-c399-4789-9f03-1112e46d2c68,min_disk=0,min_ram=0,name='',owner='9b3c0304427a4be8bec7002488a3133a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:06:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'c792114a-c399-4789-9f03-1112e46d2c68'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:19 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:19 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:06:07Z,direct_url=<?>,disk_format='qcow2',id=c792114a-c399-4789-9f03-1112e46d2c68,min_disk=0,min_ram=0,name='',owner='9b3c0304427a4be8bec7002488a3133a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:06:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-574986710',display_name='tempest-AttachSCSIVolumeTestJSON-server-574986710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-574986710',id=6,image_ref='c792114a-c399-4789-9f03-1112e46d2c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSBkr1BAv0YYB8aCxMp5qBGrQNPzy9uTR3i4NWvgjTxpzVRwzxFwRd+GhPVuEW+YfQCXauRAZz+nKC74HJ9riEWDsx5lqRDlQ63XZP7HipbezHmuaq+IwSdQrWA9lnEDQ==',key_name='tempest-keypair-1205028556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c89381edff924c5fa093f25e2e2d371f',ramdisk_id='',reservation_id='r-o4a0ty6l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c792114a-c399-4789-9f03-1112e46d2c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-828755762',owner_user_name='tempest-AttachSCSIVolumeTestJSON-828755762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='492278c0179f4b3592128bf856a8c30d',uuid=5501c668-9766-4290-8152-ee9b0a5b0d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Converting VIF {"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.objects.instance [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lazy-loading 'pci_devices' on Instance uuid 5501c668-9766-4290-8152-ee9b0a5b0d89 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:19 user nova-compute[74233]:   <uuid>5501c668-9766-4290-8152-ee9b0a5b0d89</uuid>
Oct 20 18:06:19 user nova-compute[74233]:   <name>instance-00000006</name>
Oct 20 18:06:19 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:19 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:19 user nova-compute[74233]:   <metadata>
Oct 20 18:06:19 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:19 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:19 user nova-compute[74233]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-574986710</nova:name>
Oct 20 18:06:19 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:19</nova:creationTime>
Oct 20 18:06:19 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:19 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:19 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:19 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:user uuid="492278c0179f4b3592128bf856a8c30d">tempest-AttachSCSIVolumeTestJSON-828755762-project-member</nova:user>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:project uuid="c89381edff924c5fa093f25e2e2d371f">tempest-AttachSCSIVolumeTestJSON-828755762</nova:project>
Oct 20 18:06:19 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:19 user nova-compute[74233]:       <nova:root type="image" uuid="c792114a-c399-4789-9f03-1112e46d2c68"/>
Oct 20 18:06:19 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:19 user nova-compute[74233]:         <nova:port uuid="e61a576f-6bea-40a1-9968-12245073e169">
Oct 20 18:06:19 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:06:19 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:19 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:19 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:19 user nova-compute[74233]:   </metadata>
Oct 20 18:06:19 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:19 user nova-compute[74233]:     <system>
Oct 20 18:06:19 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:19 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:19 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:19 user nova-compute[74233]:       <entry name="serial">5501c668-9766-4290-8152-ee9b0a5b0d89</entry>
Oct 20 18:06:19 user nova-compute[74233]:       <entry name="uuid">5501c668-9766-4290-8152-ee9b0a5b0d89</entry>
Oct 20 18:06:19 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:19 user nova-compute[74233]:     </system>
Oct 20 18:06:19 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:19 user nova-compute[74233]:   <os>
Oct 20 18:06:19 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:19 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:19 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:19 user nova-compute[74233]:   </os>
Oct 20 18:06:19 user nova-compute[74233]:   <features>
Oct 20 18:06:19 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:19 user nova-compute[74233]:     <apic/>
Oct 20 18:06:19 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:19 user nova-compute[74233]:   </features>
Oct 20 18:06:19 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:19 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:19 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:19 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:19 user nova-compute[74233]:   </clock>
Oct 20 18:06:19 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:19 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:19 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:19 user nova-compute[74233]:   </cpu>
Oct 20 18:06:19 user nova-compute[74233]:   <devices>
Oct 20 18:06:19 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:19 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:19 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk"/>
Oct 20 18:06:19 user nova-compute[74233]:       <target dev="sda" bus="scsi"/>
Oct 20 18:06:19 user nova-compute[74233]:       <address type="drive" controller="0" unit="0"/>
Oct 20 18:06:19 user nova-compute[74233]:     </disk>
Oct 20 18:06:19 user nova-compute[74233]:     <disk type="file" device="cdrom">
Oct 20 18:06:19 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 18:06:19 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.config"/>
Oct 20 18:06:19 user nova-compute[74233]:       <target dev="sdb" bus="scsi"/>
Oct 20 18:06:19 user nova-compute[74233]:       <address type="drive" controller="0" unit="1"/>
Oct 20 18:06:19 user nova-compute[74233]:     </disk>
Oct 20 18:06:19 user nova-compute[74233]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 18:06:19 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:19 user nova-compute[74233]:       <mac address="fa:16:3e:81:ab:73"/>
Oct 20 18:06:19 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:19 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:19 user nova-compute[74233]:       <target dev="tape61a576f-6b"/>
Oct 20 18:06:19 user nova-compute[74233]:     </interface>
Oct 20 18:06:19 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:19 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/console.log" append="off"/>
Oct 20 18:06:19 user nova-compute[74233]:     </serial>
Oct 20 18:06:19 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:19 user nova-compute[74233]:     <video>
Oct 20 18:06:19 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:19 user nova-compute[74233]:     </video>
Oct 20 18:06:19 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:19 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:19 user nova-compute[74233]:     </rng>
Oct 20 18:06:19 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:19 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:19 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:19 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:19 user nova-compute[74233]:   </devices>
Oct 20 18:06:19 user nova-compute[74233]: </domain>
Oct 20 18:06:19 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-574986710',display_name='tempest-AttachSCSIVolumeTestJSON-server-574986710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-574986710',id=6,image_ref='c792114a-c399-4789-9f03-1112e46d2c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSBkr1BAv0YYB8aCxMp5qBGrQNPzy9uTR3i4NWvgjTxpzVRwzxFwRd+GhPVuEW+YfQCXauRAZz+nKC74HJ9riEWDsx5lqRDlQ63XZP7HipbezHmuaq+IwSdQrWA9lnEDQ==',key_name='tempest-keypair-1205028556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c89381edff924c5fa093f25e2e2d371f',ramdisk_id='',reservation_id='r-o4a0ty6l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c792114a-c399-4789-9f03-1112e46d2c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-828755762',owner_user_name='tempest-AttachSCSIVolumeTestJSON-828755762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='492278c0179f4b3592128bf856a8c30d',uuid=5501c668-9766-4290-8152-ee9b0a5b0d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Converting VIF {"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG os_vif [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaa35631-1a9b-5368-9e42-216238734175', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape61a576f-6b, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape61a576f-6b, col_values=(('qos', UUID('b9dad397-db3b-4c58-88d2-a101860222f9')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape61a576f-6b, col_values=(('external_ids', {'iface-id': 'e61a576f-6bea-40a1-9968-12245073e169', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ab:73', 'vm-uuid': '5501c668-9766-4290-8152-ee9b0a5b0d89'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: INFO os_vif [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b')
Oct 20 18:06:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No BDM found with device name sda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No VIF found with MAC fa:16:3e:81:ab:73, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:19 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Using config drive
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updating instance_info_cache with network_info: [{"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Releasing lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Instance network_info: |[{"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] Acquired lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Refreshing network info cache for port bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Start _get_guest_xml network_info=[{"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1020487361',display_name='tempest-VolumesAdminNegativeTest-server-1020487361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1020487361',id=5,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVMG9wgc9Q06cVIGm5DJnnT0QWIltH3+z3bfzWdQh4Od6U6zzY5zjWUrTaKsQnmBqao5Hiwb8yZy1rtlLncnRi0MCZEx8V3AiZ4ZLn7PNOr/rO9lxNZJCCif/plYXw/OQ==',key_name='tempest-keypair-1350926343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2110b7ff17d146d1b97f0daea38053f2',ramdisk_id='',reservation_id='r-1apv7x92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-842591383',owner_user_name='tempest-VolumesAdminNegativeTest-842591383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4c6280b548459599c60b88672a963c',uuid=4597536a-b485-4bf9-938b-65471258e5e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converting VIF {"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.objects.instance [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'pci_devices' on Instance uuid 4597536a-b485-4bf9-938b-65471258e5e9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:20 user nova-compute[74233]:   <uuid>4597536a-b485-4bf9-938b-65471258e5e9</uuid>
Oct 20 18:06:20 user nova-compute[74233]:   <name>instance-00000005</name>
Oct 20 18:06:20 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:20 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:20 user nova-compute[74233]:   <metadata>
Oct 20 18:06:20 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:20 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:20 user nova-compute[74233]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1020487361</nova:name>
Oct 20 18:06:20 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:20</nova:creationTime>
Oct 20 18:06:20 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:20 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:20 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:20 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:user uuid="ef4c6280b548459599c60b88672a963c">tempest-VolumesAdminNegativeTest-842591383-project-member</nova:user>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:project uuid="2110b7ff17d146d1b97f0daea38053f2">tempest-VolumesAdminNegativeTest-842591383</nova:project>
Oct 20 18:06:20 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:20 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:20 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:20 user nova-compute[74233]:         <nova:port uuid="bf24bab0-51aa-4996-b37d-df67798591c3">
Oct 20 18:06:20 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 18:06:20 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:20 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:20 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:20 user nova-compute[74233]:   </metadata>
Oct 20 18:06:20 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:20 user nova-compute[74233]:     <system>
Oct 20 18:06:20 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:20 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:20 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:20 user nova-compute[74233]:       <entry name="serial">4597536a-b485-4bf9-938b-65471258e5e9</entry>
Oct 20 18:06:20 user nova-compute[74233]:       <entry name="uuid">4597536a-b485-4bf9-938b-65471258e5e9</entry>
Oct 20 18:06:20 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:20 user nova-compute[74233]:     </system>
Oct 20 18:06:20 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:20 user nova-compute[74233]:   <os>
Oct 20 18:06:20 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:20 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:20 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:20 user nova-compute[74233]:   </os>
Oct 20 18:06:20 user nova-compute[74233]:   <features>
Oct 20 18:06:20 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:20 user nova-compute[74233]:     <apic/>
Oct 20 18:06:20 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:20 user nova-compute[74233]:   </features>
Oct 20 18:06:20 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:20 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:20 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:20 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:20 user nova-compute[74233]:   </clock>
Oct 20 18:06:20 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:20 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:20 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:20 user nova-compute[74233]:   </cpu>
Oct 20 18:06:20 user nova-compute[74233]:   <devices>
Oct 20 18:06:20 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:20 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:20 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk"/>
Oct 20 18:06:20 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:20 user nova-compute[74233]:     </disk>
Oct 20 18:06:20 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:20 user nova-compute[74233]:       <mac address="fa:16:3e:5d:2b:59"/>
Oct 20 18:06:20 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:20 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:20 user nova-compute[74233]:       <target dev="tapbf24bab0-51"/>
Oct 20 18:06:20 user nova-compute[74233]:     </interface>
Oct 20 18:06:20 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:20 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/console.log" append="off"/>
Oct 20 18:06:20 user nova-compute[74233]:     </serial>
Oct 20 18:06:20 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:20 user nova-compute[74233]:     <video>
Oct 20 18:06:20 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:20 user nova-compute[74233]:     </video>
Oct 20 18:06:20 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:20 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:20 user nova-compute[74233]:     </rng>
Oct 20 18:06:20 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:20 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:20 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:20 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:20 user nova-compute[74233]:   </devices>
Oct 20 18:06:20 user nova-compute[74233]: </domain>
Oct 20 18:06:20 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1020487361',display_name='tempest-VolumesAdminNegativeTest-server-1020487361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1020487361',id=5,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVMG9wgc9Q06cVIGm5DJnnT0QWIltH3+z3bfzWdQh4Od6U6zzY5zjWUrTaKsQnmBqao5Hiwb8yZy1rtlLncnRi0MCZEx8V3AiZ4ZLn7PNOr/rO9lxNZJCCif/plYXw/OQ==',key_name='tempest-keypair-1350926343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2110b7ff17d146d1b97f0daea38053f2',ramdisk_id='',reservation_id='r-1apv7x92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-842591383',owner_user_name='tempest-VolumesAdminNegativeTest-842591383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4c6280b548459599c60b88672a963c',uuid=4597536a-b485-4bf9-938b-65471258e5e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converting VIF {"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG os_vif [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0ad6c60-0cdb-5d1f-b91a-178b139da051', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf24bab0-51, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf24bab0-51, col_values=(('qos', UUID('fcae175f-5c53-434e-8903-bd9f20cffb68')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf24bab0-51, col_values=(('external_ids', {'iface-id': 'bf24bab0-51aa-4996-b37d-df67798591c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:2b:59', 'vm-uuid': '4597536a-b485-4bf9-938b-65471258e5e9'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:20 user nova-compute[74233]: INFO os_vif [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51')
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No VIF found with MAC fa:16:3e:5d:2b:59, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.network.neutron [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updated VIF entry in instance network info cache for port e61a576f-6bea-40a1-9968-12245073e169. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.network.neutron [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updating instance_info_cache with network_info: [{"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8b46ab72-8fb9-4013-b541-f08ce9862cb7 req-22db8cc5-4716-4617-ac1d-c786df723849 service nova] Releasing lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] No waiting events found dispatching network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:20 user nova-compute[74233]: WARNING nova.compute.manager [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received unexpected event network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a for instance with vm_state active and task_state None.
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] No waiting events found dispatching network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:20 user nova-compute[74233]: WARNING nova.compute.manager [req-8c0798da-3f32-4440-af74-57a20f2cf066 req-3de350b9-3a93-4873-9367-b1ee2ac8d077 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received unexpected event network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a for instance with vm_state active and task_state None.
Oct 20 18:06:21 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Creating config drive at /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.config
Oct 20 18:06:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwikyl5ab {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwikyl5ab" returned: 0 in 0.081s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG nova.network.neutron [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updated VIF entry in instance network info cache for port bf24bab0-51aa-4996-b37d-df67798591c3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG nova.network.neutron [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updating instance_info_cache with network_info: [{"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-18c22c0c-efc2-49f7-977f-6559fd7ad5fd req-a710f7e5-c74c-4e78-913f-38359c576a99 service nova] Releasing lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-1536836a-d833-4c2f-bcb9-1de3db4b64ee req-ce1b653b-7aa9-4e74-b277-40bbcdfaf57c service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1536836a-d833-4c2f-bcb9-1de3db4b64ee req-ce1b653b-7aa9-4e74-b277-40bbcdfaf57c service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1536836a-d833-4c2f-bcb9-1de3db4b64ee req-ce1b653b-7aa9-4e74-b277-40bbcdfaf57c service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1536836a-d833-4c2f-bcb9-1de3db4b64ee req-ce1b653b-7aa9-4e74-b277-40bbcdfaf57c service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-1536836a-d833-4c2f-bcb9-1de3db4b64ee req-ce1b653b-7aa9-4e74-b277-40bbcdfaf57c service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:22 user nova-compute[74233]: WARNING nova.compute.manager [req-1536836a-d833-4c2f-bcb9-1de3db4b64ee req-ce1b653b-7aa9-4e74-b277-40bbcdfaf57c service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received unexpected event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with vm_state building and task_state spawning.
Oct 20 18:06:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-ee53361f-7d81-4c57-bca6-a415925da24c req-46c0c115-b0dc-4379-9488-e6e94636ac26 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ee53361f-7d81-4c57-bca6-a415925da24c req-46c0c115-b0dc-4379-9488-e6e94636ac26 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ee53361f-7d81-4c57-bca6-a415925da24c req-46c0c115-b0dc-4379-9488-e6e94636ac26 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ee53361f-7d81-4c57-bca6-a415925da24c req-46c0c115-b0dc-4379-9488-e6e94636ac26 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-ee53361f-7d81-4c57-bca6-a415925da24c req-46c0c115-b0dc-4379-9488-e6e94636ac26 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:22 user nova-compute[74233]: WARNING nova.compute.manager [req-ee53361f-7d81-4c57-bca6-a415925da24c req-46c0c115-b0dc-4379-9488-e6e94636ac26 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state None.
Oct 20 18:06:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:06:23 user nova-compute[74233]: INFO nova.compute.claims [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Claim successful on node user
Oct 20 18:06:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG nova.network.neutron [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:06:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:06:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG nova.policy [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51d30539f2ad4574bc2a7fdfbbb3eec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90929f7fd4c42bb87aba9296c3c729b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:06:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Creating image(s)
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "/opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "/opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "/opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.236s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.312s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk 1073741824" returned: 0 in 0.116s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.434s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-0c701bad-aa54-4946-a848-fc9a12330a6c req-2d563d3f-9778-422d-bbb0-39480be9065c service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0c701bad-aa54-4946-a848-fc9a12330a6c req-2d563d3f-9778-422d-bbb0-39480be9065c service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0c701bad-aa54-4946-a848-fc9a12330a6c req-2d563d3f-9778-422d-bbb0-39480be9065c service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0c701bad-aa54-4946-a848-fc9a12330a6c req-2d563d3f-9778-422d-bbb0-39480be9065c service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-0c701bad-aa54-4946-a848-fc9a12330a6c req-2d563d3f-9778-422d-bbb0-39480be9065c service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:25 user nova-compute[74233]: WARNING nova.compute.manager [req-0c701bad-aa54-4946-a848-fc9a12330a6c req-2d563d3f-9778-422d-bbb0-39480be9065c service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received unexpected event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with vm_state building and task_state spawning.
Oct 20 18:06:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.238s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-83d05d8a-a2c7-4a50-8620-cdb63160662d req-9eba67b1-97a1-4c18-ba39-de65af64cec8 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-83d05d8a-a2c7-4a50-8620-cdb63160662d req-9eba67b1-97a1-4c18-ba39-de65af64cec8 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-83d05d8a-a2c7-4a50-8620-cdb63160662d req-9eba67b1-97a1-4c18-ba39-de65af64cec8 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-83d05d8a-a2c7-4a50-8620-cdb63160662d req-9eba67b1-97a1-4c18-ba39-de65af64cec8 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-83d05d8a-a2c7-4a50-8620-cdb63160662d req-9eba67b1-97a1-4c18-ba39-de65af64cec8 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:25 user nova-compute[74233]: WARNING nova.compute.manager [req-83d05d8a-a2c7-4a50-8620-cdb63160662d req-9eba67b1-97a1-4c18-ba39-de65af64cec8 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state None.
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Cannot resize image /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Ensure instance console log exists: /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Successfully created port: 8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:06:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Successfully updated port: 8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquired lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Instance spawned successfully.
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updating instance_info_cache with network_info: [{"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Releasing lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Instance network_info: |[{"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Start _get_guest_xml network_info=[{"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:27 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:27 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1551172276',display_name='tempest-TestVolumeSwap-server-1551172276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1551172276',id=7,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwZRAvVwyB9Xzr3zw+oAFefFNmxUWhNFUELUKfDNkTI9UNBdphhh76ycu4RCAefsgoFx83CIDcw20bLufFhGK729EDcgDNmu8YiDMSewwS7RIMOX2f8erNB+f6x9ivkEw==',key_name='tempest-keypair-2090141118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90929f7fd4c42bb87aba9296c3c729b',ramdisk_id='',reservation_id='r-38g17uok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-214752244',owner_user_name='tempest-TestVolumeSwap-214752244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51d30539f2ad4574bc2a7fdfbbb3eec8',uuid=da89b953-70b8-4c12-b723-8762eb3b70dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Converting VIF {"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lazy-loading 'pci_devices' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:27 user nova-compute[74233]: INFO nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Took 13.13 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:27 user nova-compute[74233]:   <uuid>da89b953-70b8-4c12-b723-8762eb3b70dd</uuid>
Oct 20 18:06:27 user nova-compute[74233]:   <name>instance-00000007</name>
Oct 20 18:06:27 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:27 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:27 user nova-compute[74233]:   <metadata>
Oct 20 18:06:27 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:27 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:27 user nova-compute[74233]:       <nova:name>tempest-TestVolumeSwap-server-1551172276</nova:name>
Oct 20 18:06:27 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:27</nova:creationTime>
Oct 20 18:06:27 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:27 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:27 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:27 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:user uuid="51d30539f2ad4574bc2a7fdfbbb3eec8">tempest-TestVolumeSwap-214752244-project-member</nova:user>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:project uuid="a90929f7fd4c42bb87aba9296c3c729b">tempest-TestVolumeSwap-214752244</nova:project>
Oct 20 18:06:27 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:27 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:27 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:27 user nova-compute[74233]:         <nova:port uuid="8148999e-788c-4dff-bbd5-bc78a00d2c88">
Oct 20 18:06:27 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:06:27 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:27 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:27 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:27 user nova-compute[74233]:   </metadata>
Oct 20 18:06:27 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:27 user nova-compute[74233]:     <system>
Oct 20 18:06:27 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:27 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:27 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:27 user nova-compute[74233]:       <entry name="serial">da89b953-70b8-4c12-b723-8762eb3b70dd</entry>
Oct 20 18:06:27 user nova-compute[74233]:       <entry name="uuid">da89b953-70b8-4c12-b723-8762eb3b70dd</entry>
Oct 20 18:06:27 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:27 user nova-compute[74233]:     </system>
Oct 20 18:06:27 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:27 user nova-compute[74233]:   <os>
Oct 20 18:06:27 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:27 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:27 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:27 user nova-compute[74233]:   </os>
Oct 20 18:06:27 user nova-compute[74233]:   <features>
Oct 20 18:06:27 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:27 user nova-compute[74233]:     <apic/>
Oct 20 18:06:27 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:27 user nova-compute[74233]:   </features>
Oct 20 18:06:27 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:27 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:27 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:27 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:27 user nova-compute[74233]:   </clock>
Oct 20 18:06:27 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:27 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:27 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:27 user nova-compute[74233]:   </cpu>
Oct 20 18:06:27 user nova-compute[74233]:   <devices>
Oct 20 18:06:27 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:27 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:27 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk"/>
Oct 20 18:06:27 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:27 user nova-compute[74233]:     </disk>
Oct 20 18:06:27 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:27 user nova-compute[74233]:       <mac address="fa:16:3e:ff:20:54"/>
Oct 20 18:06:27 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:27 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:27 user nova-compute[74233]:       <target dev="tap8148999e-78"/>
Oct 20 18:06:27 user nova-compute[74233]:     </interface>
Oct 20 18:06:27 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:27 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/console.log" append="off"/>
Oct 20 18:06:27 user nova-compute[74233]:     </serial>
Oct 20 18:06:27 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:27 user nova-compute[74233]:     <video>
Oct 20 18:06:27 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:27 user nova-compute[74233]:     </video>
Oct 20 18:06:27 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:27 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:27 user nova-compute[74233]:     </rng>
Oct 20 18:06:27 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:27 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:27 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:27 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:27 user nova-compute[74233]:   </devices>
Oct 20 18:06:27 user nova-compute[74233]: </domain>
Oct 20 18:06:27 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1551172276',display_name='tempest-TestVolumeSwap-server-1551172276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1551172276',id=7,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwZRAvVwyB9Xzr3zw+oAFefFNmxUWhNFUELUKfDNkTI9UNBdphhh76ycu4RCAefsgoFx83CIDcw20bLufFhGK729EDcgDNmu8YiDMSewwS7RIMOX2f8erNB+f6x9ivkEw==',key_name='tempest-keypair-2090141118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90929f7fd4c42bb87aba9296c3c729b',ramdisk_id='',reservation_id='r-38g17uok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-214752244',owner_user_name='tempest-TestVolumeSwap-214752244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51d30539f2ad4574bc2a7fdfbbb3eec8',uuid=da89b953-70b8-4c12-b723-8762eb3b70dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Converting VIF {"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG os_vif [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7377b2b-5087-5188-9089-6a0209611326', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8148999e-78, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8148999e-78, col_values=(('qos', UUID('cf09b8fe-2f94-4ff3-a6c9-687230003312')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8148999e-78, col_values=(('external_ids', {'iface-id': '8148999e-788c-4dff-bbd5-bc78a00d2c88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:20:54', 'vm-uuid': 'da89b953-70b8-4c12-b723-8762eb3b70dd'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:27 user nova-compute[74233]: INFO os_vif [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78')
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] No VIF found with MAC fa:16:3e:ff:20:54, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:27 user nova-compute[74233]: INFO nova.compute.manager [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Took 14.74 seconds to build instance.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3446b759-a28f-43e6-86b1-9b8bb04ffcfd tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] No waiting events found dispatching network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:27 user nova-compute[74233]: WARNING nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received unexpected event network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 for instance with vm_state building and task_state spawning.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] No waiting events found dispatching network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:27 user nova-compute[74233]: WARNING nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received unexpected event network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 for instance with vm_state building and task_state spawning.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-changed-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Refreshing instance network info cache due to event network-changed-8148999e-788c-4dff-bbd5-bc78a00d2c88. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Acquiring lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Acquired lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Refreshing network info cache for port 8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Instance spawned successfully.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:27 user nova-compute[74233]: INFO nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Took 11.92 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:27 user nova-compute[74233]: INFO nova.compute.manager [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Took 13.24 seconds to build instance.
Oct 20 18:06:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-740e65be-15ef-48fd-8dde-3a0276aaa995 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.481s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updated VIF entry in instance network info cache for port 8148999e-788c-4dff-bbd5-bc78a00d2c88. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updating instance_info_cache with network_info: [{"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-162474a5-bb5c-4ddc-9c2a-7a4207cfe9e4 req-28fb44e0-5c17-494b-a69a-f66fc05d48e0 service nova] Releasing lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-e5d9f331-3c43-4611-80b3-e1f75857b5a2 req-87429b58-336d-4628-b1a9-6d4d6d108d8c service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5d9f331-3c43-4611-80b3-e1f75857b5a2 req-87429b58-336d-4628-b1a9-6d4d6d108d8c service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5d9f331-3c43-4611-80b3-e1f75857b5a2 req-87429b58-336d-4628-b1a9-6d4d6d108d8c service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5d9f331-3c43-4611-80b3-e1f75857b5a2 req-87429b58-336d-4628-b1a9-6d4d6d108d8c service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-e5d9f331-3c43-4611-80b3-e1f75857b5a2 req-87429b58-336d-4628-b1a9-6d4d6d108d8c service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:29 user nova-compute[74233]: WARNING nova.compute.manager [req-e5d9f331-3c43-4611-80b3-e1f75857b5a2 req-87429b58-336d-4628-b1a9-6d4d6d108d8c service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state building and task_state spawning.
Oct 20 18:06:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Instance spawned successfully.
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:31 user nova-compute[74233]: INFO nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Took 7.34 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:31 user nova-compute[74233]: INFO nova.compute.manager [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Took 8.54 seconds to build instance.
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff6a1891-ca93-497c-8285-a710cce058ef req-39ac41b6-c1ee-4729-a42e-64e043410d44 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff6a1891-ca93-497c-8285-a710cce058ef req-39ac41b6-c1ee-4729-a42e-64e043410d44 service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff6a1891-ca93-497c-8285-a710cce058ef req-39ac41b6-c1ee-4729-a42e-64e043410d44 service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff6a1891-ca93-497c-8285-a710cce058ef req-39ac41b6-c1ee-4729-a42e-64e043410d44 service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff6a1891-ca93-497c-8285-a710cce058ef req-39ac41b6-c1ee-4729-a42e-64e043410d44 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:31 user nova-compute[74233]: WARNING nova.compute.manager [req-ff6a1891-ca93-497c-8285-a710cce058ef req-39ac41b6-c1ee-4729-a42e-64e043410d44 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state active and task_state None.
Oct 20 18:06:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ed26fe36-56bf-4252-9bb9-29308ecfee96 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.754s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:06:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:06:35 user nova-compute[74233]: INFO nova.compute.claims [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Claim successful on node user
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:06:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.policy [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a1ef5af49f549df9b09640493a9745a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db657bd6ae54226814be3f4abfeeebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:06:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Creating image(s)
Oct 20 18:06:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "/opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "/opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "/opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.222s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.210s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk 1073741824" returned: 0 in 0.075s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.267s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Successfully created port: 1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Cannot resize image /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Ensure instance console log exists: /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Successfully updated port: 1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquired lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-changed-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Refreshing instance network info cache due to event network-changed-1ee394bd-2e7e-4d9c-b032-235c936fe93b. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:06:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] Acquiring lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updating instance_info_cache with network_info: [{"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Releasing lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Instance network_info: |[{"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] Acquired lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Refreshing network info cache for port 1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Start _get_guest_xml network_info=[{"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:06:39 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:39 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1613662639',display_name='tempest-VolumesAssistedSnapshotsTest-server-1613662639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1613662639',id=8,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr/k8jYEuhBJRNqSvdUJhtLpo6SHZNEr7FyvX44UHZVsBe0Gnswa/Y7jGp79J0H4B7BY/ZqIFAOTQ1rb9Pg6Zf5JYuk+qyKsYloAbTSIoBYTKYHbesbV/mgl5Tu1Qwthg==',key_name='tempest-keypair-1173838449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db657bd6ae54226814be3f4abfeeebb',ramdisk_id='',reservation_id='r-ikd0pua1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1600140476',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1600140476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a1ef5af49f549df9b09640493a9745a',uuid=51272c8a-2505-4779-bd9c-af9f352f7b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Converting VIF {"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.objects.instance [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lazy-loading 'pci_devices' on Instance uuid 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:06:39 user nova-compute[74233]:   <uuid>51272c8a-2505-4779-bd9c-af9f352f7b7b</uuid>
Oct 20 18:06:39 user nova-compute[74233]:   <name>instance-00000008</name>
Oct 20 18:06:39 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:06:39 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:06:39 user nova-compute[74233]:   <metadata>
Oct 20 18:06:39 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:06:39 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:06:39 user nova-compute[74233]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1613662639</nova:name>
Oct 20 18:06:39 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:06:39</nova:creationTime>
Oct 20 18:06:39 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:06:39 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:06:39 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:06:39 user nova-compute[74233]:       <nova:owner>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:user uuid="6a1ef5af49f549df9b09640493a9745a">tempest-VolumesAssistedSnapshotsTest-1600140476-project-member</nova:user>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:project uuid="4db657bd6ae54226814be3f4abfeeebb">tempest-VolumesAssistedSnapshotsTest-1600140476</nova:project>
Oct 20 18:06:39 user nova-compute[74233]:       </nova:owner>
Oct 20 18:06:39 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:06:39 user nova-compute[74233]:       <nova:ports>
Oct 20 18:06:39 user nova-compute[74233]:         <nova:port uuid="1ee394bd-2e7e-4d9c-b032-235c936fe93b">
Oct 20 18:06:39 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 18:06:39 user nova-compute[74233]:         </nova:port>
Oct 20 18:06:39 user nova-compute[74233]:       </nova:ports>
Oct 20 18:06:39 user nova-compute[74233]:     </nova:instance>
Oct 20 18:06:39 user nova-compute[74233]:   </metadata>
Oct 20 18:06:39 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:06:39 user nova-compute[74233]:     <system>
Oct 20 18:06:39 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:06:39 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:06:39 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:06:39 user nova-compute[74233]:       <entry name="serial">51272c8a-2505-4779-bd9c-af9f352f7b7b</entry>
Oct 20 18:06:39 user nova-compute[74233]:       <entry name="uuid">51272c8a-2505-4779-bd9c-af9f352f7b7b</entry>
Oct 20 18:06:39 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:06:39 user nova-compute[74233]:     </system>
Oct 20 18:06:39 user nova-compute[74233]:   </sysinfo>
Oct 20 18:06:39 user nova-compute[74233]:   <os>
Oct 20 18:06:39 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:06:39 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:06:39 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:06:39 user nova-compute[74233]:   </os>
Oct 20 18:06:39 user nova-compute[74233]:   <features>
Oct 20 18:06:39 user nova-compute[74233]:     <acpi/>
Oct 20 18:06:39 user nova-compute[74233]:     <apic/>
Oct 20 18:06:39 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:06:39 user nova-compute[74233]:   </features>
Oct 20 18:06:39 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:06:39 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:06:39 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:06:39 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:06:39 user nova-compute[74233]:   </clock>
Oct 20 18:06:39 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:06:39 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:06:39 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:06:39 user nova-compute[74233]:   </cpu>
Oct 20 18:06:39 user nova-compute[74233]:   <devices>
Oct 20 18:06:39 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:06:39 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:06:39 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk"/>
Oct 20 18:06:39 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:06:39 user nova-compute[74233]:     </disk>
Oct 20 18:06:39 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:06:39 user nova-compute[74233]:       <mac address="fa:16:3e:73:67:56"/>
Oct 20 18:06:39 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:39 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:06:39 user nova-compute[74233]:       <target dev="tap1ee394bd-2e"/>
Oct 20 18:06:39 user nova-compute[74233]:     </interface>
Oct 20 18:06:39 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:06:39 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/console.log" append="off"/>
Oct 20 18:06:39 user nova-compute[74233]:     </serial>
Oct 20 18:06:39 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:06:39 user nova-compute[74233]:     <video>
Oct 20 18:06:39 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:06:39 user nova-compute[74233]:     </video>
Oct 20 18:06:39 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:06:39 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:06:39 user nova-compute[74233]:     </rng>
Oct 20 18:06:39 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:06:39 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:06:39 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:06:39 user nova-compute[74233]:     </memballoon>
Oct 20 18:06:39 user nova-compute[74233]:   </devices>
Oct 20 18:06:39 user nova-compute[74233]: </domain>
Oct 20 18:06:39 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1613662639',display_name='tempest-VolumesAssistedSnapshotsTest-server-1613662639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1613662639',id=8,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr/k8jYEuhBJRNqSvdUJhtLpo6SHZNEr7FyvX44UHZVsBe0Gnswa/Y7jGp79J0H4B7BY/ZqIFAOTQ1rb9Pg6Zf5JYuk+qyKsYloAbTSIoBYTKYHbesbV/mgl5Tu1Qwthg==',key_name='tempest-keypair-1173838449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db657bd6ae54226814be3f4abfeeebb',ramdisk_id='',reservation_id='r-ikd0pua1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1600140476',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1600140476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a1ef5af49f549df9b09640493a9745a',uuid=51272c8a-2505-4779-bd9c-af9f352f7b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Converting VIF {"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG os_vif [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93dfeed2-942a-5e43-a130-d296fd5be1bc', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ee394bd-2e, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ee394bd-2e, col_values=(('qos', UUID('0ae5b558-a7ee-45fe-b2ac-a463de9172ac')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ee394bd-2e, col_values=(('external_ids', {'iface-id': '1ee394bd-2e7e-4d9c-b032-235c936fe93b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:67:56', 'vm-uuid': '51272c8a-2505-4779-bd9c-af9f352f7b7b'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: INFO os_vif [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e')
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] No VIF found with MAC fa:16:3e:73:67:56, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updated VIF entry in instance network info cache for port 1ee394bd-2e7e-4d9c-b032-235c936fe93b. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updating instance_info_cache with network_info: [{"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b025bebf-ef83-42e7-9c23-86e1b697c547 req-51ea9526-bc68-458d-96e5-cdf06f20646a service nova] Releasing lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0544673-b9d1-4d79-8588-e57c934a0d3b req-665b370e-e2e0-4e99-8b21-5af0e4e8835e service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0544673-b9d1-4d79-8588-e57c934a0d3b req-665b370e-e2e0-4e99-8b21-5af0e4e8835e service nova] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0544673-b9d1-4d79-8588-e57c934a0d3b req-665b370e-e2e0-4e99-8b21-5af0e4e8835e service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0544673-b9d1-4d79-8588-e57c934a0d3b req-665b370e-e2e0-4e99-8b21-5af0e4e8835e service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0544673-b9d1-4d79-8588-e57c934a0d3b req-665b370e-e2e0-4e99-8b21-5af0e4e8835e service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] No waiting events found dispatching network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:41 user nova-compute[74233]: WARNING nova.compute.manager [req-a0544673-b9d1-4d79-8588-e57c934a0d3b req-665b370e-e2e0-4e99-8b21-5af0e4e8835e service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received unexpected event network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b for instance with vm_state building and task_state spawning.
Oct 20 18:06:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-b5ba8178-b78a-4e45-a4f0-75965d9e64c7 req-686f0304-c827-499d-b0cc-eb07b81f67f2 service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b5ba8178-b78a-4e45-a4f0-75965d9e64c7 req-686f0304-c827-499d-b0cc-eb07b81f67f2 service nova] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b5ba8178-b78a-4e45-a4f0-75965d9e64c7 req-686f0304-c827-499d-b0cc-eb07b81f67f2 service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b5ba8178-b78a-4e45-a4f0-75965d9e64c7 req-686f0304-c827-499d-b0cc-eb07b81f67f2 service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-b5ba8178-b78a-4e45-a4f0-75965d9e64c7 req-686f0304-c827-499d-b0cc-eb07b81f67f2 service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] No waiting events found dispatching network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:06:43 user nova-compute[74233]: WARNING nova.compute.manager [req-b5ba8178-b78a-4e45-a4f0-75965d9e64c7 req-686f0304-c827-499d-b0cc-eb07b81f67f2 service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received unexpected event network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b for instance with vm_state building and task_state spawning.
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:06:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Instance spawned successfully.
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:06:43 user nova-compute[74233]: INFO nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Took 7.00 seconds to spawn the instance on the hypervisor.
Oct 20 18:06:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:43 user nova-compute[74233]: INFO nova.compute.manager [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Took 7.99 seconds to build instance.
Oct 20 18:06:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-77bc9894-edfd-4059-a7a7-365109eb4bc8 tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.117s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:06:46 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updating instance_info_cache with network_info: [{"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-52047bb0-5fcf-4de4-851d-c3526ae9ecf9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:47 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:06:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:06:52 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:52 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=25.567886352539062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4597536a-b485-4bf9-938b-65471258e5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5501c668-9766-4290-8152-ee9b0a5b0d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance da89b953-70b8-4c12-b723-8762eb3b70dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 51272c8a-2505-4779-bd9c-af9f352f7b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:06:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.963s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:06:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:06:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:06:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:07:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:07:47 user nova-compute[74233]: INFO nova.compute.manager [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] instance snapshotting
Oct 20 18:07:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:07:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:07:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:07:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Beginning live snapshot process
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5dx2xgag/81806ed4c33a463e8f1d51cc1714b39b.delta 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5dx2xgag/81806ed4c33a463e8f1d51cc1714b39b.delta 1073741824" returned: 0 in 0.059s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74233) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 18:07:48 user nova-compute[74233]: INFO nova.virt.libvirt.host [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] UEFI support detected
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-changed-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Refreshing instance network info cache due to event network-changed-b5309b28-7869-4a97-9e33-baf666deb08a. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] Acquiring lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] Acquired lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Refreshing network info cache for port b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:07:48 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updated VIF entry in instance network info cache for port b5309b28-7869-4a97-9e33-baf666deb08a. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updating instance_info_cache with network_info: [{"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fca058e4-35f3-4e8c-9216-098bc0415fd2 req-b76320ec-0c77-42a5-a40a-9865aa237cdc service nova] Releasing lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lazy-loading 'flavor' on Instance uuid 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.173s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:07:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 18:07:50 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5dx2xgag/81806ed4c33a463e8f1d51cc1714b39b.delta /opt/stack/data/nova/instances/snapshots/tmp5dx2xgag/81806ed4c33a463e8f1d51cc1714b39b {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing instance network info cache due to event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG nova.network.neutron [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:07:50 user nova-compute[74233]: INFO nova.compute.manager [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Attaching volume 6b9075c2-cc80-439d-9763-298ad7255360 to /dev/vdb
Oct 20 18:07:50 user nova-compute[74233]: DEBUG os_brick.utils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:07:50 user nova-compute[74233]: INFO oslo.privsep.daemon [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprf5s3mvb/privsep.sock']
Oct 20 18:07:50 user sudo[85292]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprf5s3mvb/privsep.sock
Oct 20 18:07:50 user sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5dx2xgag/81806ed4c33a463e8f1d51cc1714b39b.delta /opt/stack/data/nova/instances/snapshots/tmp5dx2xgag/81806ed4c33a463e8f1d51cc1714b39b" returned: 0 in 0.457s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Snapshot extracted, beginning image upload
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG nova.network.neutron [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updated VIF entry in instance network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG nova.network.neutron [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23682588-134c-416b-849b-94963d5d6707 req-5b1152f5-ebb6-4bb2-9609-e38a4df36acd service nova] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:07:51 user nova-compute[74233]: INFO nova.compute.manager [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] instance snapshotting
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Beginning live snapshot process
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user sudo[85292]: pam_unix(sudo:session): session closed for user root
Oct 20 18:07:52 user nova-compute[74233]: INFO oslo.privsep.daemon [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Spawned new privsep daemon via rootwrap
Oct 20 18:07:52 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 18:07:52 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 18:07:52 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 18:07:52 user nova-compute[74233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85316
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53dcac5-de63-44a5-9a73-46fff41053e6]: (2,) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132617d-a160-4b36-aa23-d84ab1c94fea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:52 user nova-compute[74233]: WARNING os_brick.initiator.connectors.nvmeof [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f36c4eb-4b20-4edc-bff0-47fcdae3bd0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa58b41-3be0-42a5-8261-4a5273b424ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52809519-e067-4dc8-8651-ac597f9d8a87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:07:52 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2e255-303a-451a-bb3b-522cd59a92a6]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG os_brick.utils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] <== get_connector_properties: return (2249ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updating existing volume attachment record: aad5cc11-fbc4-4f07-97d0-4ed9f9a09269 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiqhx_5bj/ce021665d2584fe381363b9a7253e48e.delta 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiqhx_5bj/ce021665d2584fe381363b9a7253e48e.delta 1073741824" returned: 0 in 0.051s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 18:07:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] COPY block job progress, current cursor: 1114112 final cursor: 75497472 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:07:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:54 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:07:54 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7475MB free_disk=25.501361846923828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:07:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Snapshot image upload complete
Oct 20 18:07:54 user nova-compute[74233]: INFO nova.compute.manager [None req-4bd08120-326e-4624-aa95-fded6e4992d4 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Took 6.94 seconds to snapshot the instance on the hypervisor.
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiqhx_5bj/ce021665d2584fe381363b9a7253e48e.delta /opt/stack/data/nova/instances/snapshots/tmpiqhx_5bj/ce021665d2584fe381363b9a7253e48e {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4597536a-b485-4bf9-938b-65471258e5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5501c668-9766-4290-8152-ee9b0a5b0d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance da89b953-70b8-4c12-b723-8762eb3b70dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 51272c8a-2505-4779-bd9c-af9f352f7b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:07:54 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiqhx_5bj/ce021665d2584fe381363b9a7253e48e.delta /opt/stack/data/nova/instances/snapshots/tmpiqhx_5bj/ce021665d2584fe381363b9a7253e48e" returned: 0 in 0.293s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Snapshot extracted, beginning image upload
Oct 20 18:07:55 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:07:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:07:56 user nova-compute[74233]: INFO nova.compute.manager [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Attaching volume 8b729192-b8e9-46c5-bf24-12e12adb6a88 to /dev/vdb
Oct 20 18:07:56 user nova-compute[74233]: DEBUG os_brick.utils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e00baf-d4b5-4ff4-a0a8-7bc9e14db3a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb2d787-5de6-40e2-b417-28e82d60a7d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf1dab5-112a-46a0-930c-eb4207be8939]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2481c6aa-c4dd-4ded-8f17-b07ba11fcc8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:07:56 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:07:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb4932-ee09-4d36-b164-980282424143]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG os_brick.utils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:07:56 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updating existing volume attachment record: c3b41ce6-b51e-4ef3-bbc7-037c0891de22 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:07:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Snapshot image upload complete
Oct 20 18:07:58 user nova-compute[74233]: INFO nova.compute.manager [None req-0b5d1b91-1126-4fb1-9001-ae516e384f6f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Took 6.41 seconds to snapshot the instance on the hypervisor.
Oct 20 18:07:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:07:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-changed-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Refreshing instance network info cache due to event network-changed-bf24bab0-51aa-4996-b37d-df67798591c3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] Acquiring lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] Acquired lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Refreshing network info cache for port bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updated VIF entry in instance network info cache for port bf24bab0-51aa-4996-b37d-df67798591c3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:08:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updating instance_info_cache with network_info: [{"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-435a48b6-9a7c-4fb3-bffa-821d8eca209e req-aab6f66d-095a-411b-85d1-8609de1f7c50 service nova] Releasing lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-changed-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Refreshing instance network info cache due to event network-changed-e61a576f-6bea-40a1-9968-12245073e169. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] Acquiring lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] Acquired lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Refreshing network info cache for port e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updated VIF entry in instance network info cache for port e61a576f-6bea-40a1-9968-12245073e169. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updating instance_info_cache with network_info: [{"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b56f2f71-d6aa-4f55-84a6-6e6598d445cc req-c78576cf-0c0c-434a-8d81-033434f5a441 service nova] Releasing lock "refresh_cache-5501c668-9766-4290-8152-ee9b0a5b0d89" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:10 user nova-compute[74233]: DEBUG nova.objects.instance [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'flavor' on Instance uuid 4597536a-b485-4bf9-938b-65471258e5e9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:11 user nova-compute[74233]: INFO nova.compute.manager [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Attaching volume 9f014afc-b607-463f-9841-1f68ebd8c918 to /dev/vdb
Oct 20 18:08:11 user nova-compute[74233]: DEBUG os_brick.utils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd23d8-7bca-457a-94e4-9fd6e3355aef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d28c5a6-d731-4e75-bc17-7d809b0f057b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee80ef-1c5b-4f52-a78a-e7ccc41b8120]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b3545-0c55-4739-8aa6-83f9637271fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:11 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:08:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5e46a-2b98-4bf7-822a-7c15cb25863a]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG os_brick.utils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updating existing volume attachment record: 338e068e-bcca-46c9-9a3b-329191296894 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:08:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connector [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Factory for ISCSI on None {{(pid=74233) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crsHkXUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:12 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf80efe-277f-4eb7-b3e6-5283ae074504]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:08:12 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[88219fff-10da-40a7-8b45-4e57f4d3c238]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360] added
Oct 20 18:08:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[524eb1c5-18eb-417d-992e-c83c5224ddec]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30267769-9d61-482e-b814-10f04297d243]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crsHkXUq {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crsHkXUq" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e5fe0-58ba-4291-88ef-f231c0b58881]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crsHkXUq'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb1aef8-a460-4e21-869a-a98e24ca7d32]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[99233618-5c6f-4d1f-929a-31e5212a1dfc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:08:12 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:08:12 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:08:12 user nova-compute[74233]: 
Oct 20 18:08:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b869736-309d-44f0-92ca-8a37330b8d79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260]
Oct 20 18:08:13 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260] successful.
Oct 20 18:08:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[203bee32-f05a-4bd3-94be-3a93d32d1eb7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7336b66-621f-4a1e-a822-d50fff7c45f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 (non-flash)
Oct 20 18:08:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 (non-flash)
Oct 20 18:08:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a41c61-bbbd-438c-bb63-10b55d56c271]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crsHkXUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lazy-loading 'flavor' on Instance uuid 5501c668-9766-4290-8152-ee9b0a5b0d89 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:13 user nova-compute[74233]: INFO nova.compute.manager [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Attaching volume 7a7af421-c8d6-46f9-a2b6-f3f376c9f17e to /dev/sdc
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.utils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa889d22-b6ce-49d9-ad25-499bc8c37465]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb27080-e8d7-4ac2-91d5-3a79df55828b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1191c59c-3f42-4c14-8f70-f3812fed8c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a59bb-a536-4857-a2b5-692c7c154b1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:13 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:08:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b696b9b-1dc8-416d-adee-8339faa90d6f]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG os_brick.utils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:13 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updating existing volume attachment record: 2ad67e5e-e53c-4fdf-8bce-92e21f51d533 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26264386538326335', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264386538326335', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.objects.instance [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lazy-loading 'flavor' on Instance uuid 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:08:14 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:14 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:08:14 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:08:14 user nova-compute[74233]:   <serial>6b9075c2-cc80-439d-9763-298ad7255360</serial>
Oct 20 18:08:14 user nova-compute[74233]: </disk>
Oct 20 18:08:14 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-changed-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Refreshing instance network info cache due to event network-changed-8148999e-788c-4dff-bbd5-bc78a00d2c88. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] Acquiring lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] Acquired lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.network.neutron [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Refreshing network info cache for port 8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] No VIF found with MAC fa:16:3e:aa:30:c4, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:15 user nova-compute[74233]: DEBUG nova.network.neutron [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updated VIF entry in instance network info cache for port 8148999e-788c-4dff-bbd5-bc78a00d2c88. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:08:15 user nova-compute[74233]: DEBUG nova.network.neutron [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updating instance_info_cache with network_info: [{"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b90115dd-ba43-49bf-9c34-8b8d1fba69bd req-97aa3dc0-5b79-4d77-8482-5663dfee818e service nova] Releasing lock "refresh_cache-da89b953-70b8-4c12-b723-8762eb3b70dd" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.volume.cinder [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Update attachment failed for attachment c3b41ce6-b51e-4ef3-bbc7-037c0891de22. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-00c607d7-a8f5-4792-b104-4d043905604e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-00c607d7-a8f5-4792-b104-4d043905604e)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Failed to attach 8b729192-b8e9-46c5-bf24-12e12adb6a88 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-00c607d7-a8f5-4792-b104-4d043905604e)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Traceback (most recent call last):
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     self._do_attach(context, instance, volume, volume_api,
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     self._volume_attach(context, volume, connector, instance,
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     connection_info = volume_api.attachment_update(
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     res = method(self, ctx, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     with excutils.save_and_reraise_exception():
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     self.force_reraise()
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     raise self.value
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     return method.func(obj, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     resp = self._update('/attachments/%s' % id, body)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     return self.request(url, method, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936]     raise exceptions.from_response(resp, body)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-00c607d7-a8f5-4792-b104-4d043905604e)
Oct 20 18:08:16 user nova-compute[74233]: ERROR nova.compute.manager [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] 
Oct 20 18:08:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:16 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lazy-loading 'flavor' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1ad4a7e4-28b4-4362-91dd-ef5c3a9c4d19 tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.378s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.758s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server [None req-d61e376c-2f22-4504-99a0-9469db29d6ee tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-00c607d7-a8f5-4792-b104-4d043905604e)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-00c607d7-a8f5-4792-b104-4d043905604e)
Oct 20 18:08:16 user nova-compute[74233]: ERROR oslo_messaging.rpc.server 
Oct 20 18:08:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:17 user nova-compute[74233]: INFO nova.compute.manager [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Attaching volume 027a801e-8dfe-4970-89eb-77f9b334f4a6 to /dev/vdb
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:17 user nova-compute[74233]: INFO nova.compute.manager [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Terminating instance
Oct 20 18:08:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG os_brick.utils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf12ea91-c9b2-4ca0-be07-de747aefe816]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22408b9b-7a32-4713-9677-153662417ff7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cee404f-8c0c-40d1-b3fc-fb566cd45e79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab9caa-f768-4d12-afba-d0210066b85d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:17 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:08:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a6662-8b9c-44b1-af81-7046caf889f4]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG os_brick.utils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updating existing volume attachment record: b373f0d9-1847-4f05-9848-e8a7244ee085 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:08:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Instance destroyed successfully.
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lazy-loading 'resources' on Instance uuid 52047bb0-5fcf-4de4-851d-c3526ae9ecf9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1773192317',display_name='tempest-DeleteServersTestJSON-server-1773192317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1773192317',id=1,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='088c6c41b354479bbb30d00217081fae',ramdisk_id='',reservation_id='r-0ep7uvo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1800105009',owner_user_name='tempest-DeleteServersTestJSON-1800105009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:06:13Z,user_data=None,user_id='693eb6d3b55d4934bdc51bd28d95f8e9',uuid=52047bb0-5fcf-4de4-851d-c3526ae9ecf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Converting VIF {"id": "03d38729-8f95-4ab2-b711-934597b6a333", "address": "fa:16:3e:aa:30:c4", "network": {"id": "87352fd1-3e69-40c2-8582-b3ed91f23269", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486370625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "088c6c41b354479bbb30d00217081fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d38729-8f", "ovs_interfaceid": "03d38729-8f95-4ab2-b711-934597b6a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_vif [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03d38729-8f, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f87076e-095a-4ac9-9e76-1415c8359c8d) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:08:18 user nova-compute[74233]: INFO os_vif [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=03d38729-8f95-4ab2-b711-934597b6a333,network=Network(87352fd1-3e69-40c2-8582-b3ed91f23269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d38729-8f')
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crsHkXUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:18 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd97b40f-4693-4b07-a111-82b5d295d77c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:08:18 user nova-compute[74233]: No targets found.
Oct 20 18:08:18 user nova-compute[74233]: iSNS:
Oct 20 18:08:18 user nova-compute[74233]: No targets found.
Oct 20 18:08:18 user nova-compute[74233]: STATIC:
Oct 20 18:08:18 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360
Oct 20 18:08:18 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:08:18 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:08:18 user nova-compute[74233]: FIRMWARE:
Oct 20 18:08:18 user nova-compute[74233]: No targets found.
Oct 20 18:08:18 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:08:18 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:08:18 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a467a00-1be2-43fa-ae42-12d73334f65b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd6c48c-bb8a-4fe7-ab12-53d2fd4adcce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 (non-flash)
Oct 20 18:08:18 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 (non-flash)
Oct 20 18:08:18 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970783490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57251f66-96d9-414a-9897-1545959fb449]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35d146d-4e33-47f8-9891-27f90574bfcd]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[310792ec-6946-4bd1-a573-8c86e7d93aa6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5cfef0-28d0-48a3-be3b-8d661bd16a2e]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2840d97-88ee-4728-a29a-e8d9108b544b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a840a8-7ffe-45f7-9432-4c78edc2b401]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260]
Oct 20 18:08:18 user nova-compute[74233]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360, portal: 172.16.0.220,3260] successful.
Oct 20 18:08:18 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9075c2-cc80-439d-9763-298ad7255360 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a1e65f-a453-4732-ba86-bcdfabad5b58]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] <== disconnect_volume: return (357ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:08:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Deleting instance files /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9_del
Oct 20 18:08:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Deletion of /opt/stack/data/nova/instances/52047bb0-5fcf-4de4-851d-c3526ae9ecf9_del complete
Oct 20 18:08:18 user nova-compute[74233]: INFO nova.compute.manager [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-deaf25ba-5089-457a-b1a1-5f387ca2c98b req-46952384-c908-4ec5-8d49-efa5f329386b service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-vif-unplugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-deaf25ba-5089-457a-b1a1-5f387ca2c98b req-46952384-c908-4ec5-8d49-efa5f329386b service nova] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-deaf25ba-5089-457a-b1a1-5f387ca2c98b req-46952384-c908-4ec5-8d49-efa5f329386b service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-deaf25ba-5089-457a-b1a1-5f387ca2c98b req-46952384-c908-4ec5-8d49-efa5f329386b service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-deaf25ba-5089-457a-b1a1-5f387ca2c98b req-46952384-c908-4ec5-8d49-efa5f329386b service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] No waiting events found dispatching network-vif-unplugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:08:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-deaf25ba-5089-457a-b1a1-5f387ca2c98b req-46952384-c908-4ec5-8d49-efa5f329386b service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-vif-unplugged-03d38729-8f95-4ab2-b711-934597b6a333 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:08:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:20 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:20 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Took 2.19 seconds to deallocate network for instance.
Oct 20 18:08:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-0cf3d42e-7b70-4fbe-9959-4a197c8adc3b req-9f218ae7-1778-486b-a705-fd2f73d1f383 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-vif-deleted-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-6e2d241c-3e61-41eb-92f2-ad4c59b6bda7 req-c6589337-744a-45be-a133-1e2ca1e719b7 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received event network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6e2d241c-3e61-41eb-92f2-ad4c59b6bda7 req-c6589337-744a-45be-a133-1e2ca1e719b7 service nova] Acquiring lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6e2d241c-3e61-41eb-92f2-ad4c59b6bda7 req-c6589337-744a-45be-a133-1e2ca1e719b7 service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6e2d241c-3e61-41eb-92f2-ad4c59b6bda7 req-c6589337-744a-45be-a133-1e2ca1e719b7 service nova] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-6e2d241c-3e61-41eb-92f2-ad4c59b6bda7 req-c6589337-744a-45be-a133-1e2ca1e719b7 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] No waiting events found dispatching network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:08:20 user nova-compute[74233]: WARNING nova.compute.manager [req-6e2d241c-3e61-41eb-92f2-ad4c59b6bda7 req-c6589337-744a-45be-a133-1e2ca1e719b7 service nova] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Received unexpected event network-vif-plugged-03d38729-8f95-4ab2-b711-934597b6a333 for instance with vm_state active and task_state deleting.
Oct 20 18:08:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-changed-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Refreshing instance network info cache due to event network-changed-1ee394bd-2e7e-4d9c-b032-235c936fe93b. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] Acquiring lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] Acquired lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Refreshing network info cache for port 1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:08:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updated VIF entry in instance network info cache for port 1ee394bd-2e7e-4d9c-b032-235c936fe93b. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:08:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updating instance_info_cache with network_info: [{"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5cb28971-bfaf-4659-aa90-03bb1ce64e06 req-a2956d9d-bd6e-45f8-ab47-ed7dcf1b0e7a service nova] Releasing lock "refresh_cache-51272c8a-2505-4779-bd9c-af9f352f7b7b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwLPXETS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:30 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d47cb55-258e-4dea-b269-259eb56168b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:08:30 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[898fcbf5-893b-4d62-a032-89a4fe16d190]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918] added
Oct 20 18:08:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7477e47-ee29-49ed-aeb3-36ee0656492d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[979dae84-48d0-4f67-9e8b-c8d26d5460b4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MwLPXETS {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MwLPXETS" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97bfe4b-2393-466b-8c46-1c2051963b86]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MwLPXETS'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8eef9-2d1c-4c6e-9f2b-bcf04b83ea31]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c218301-9b53-41ed-b7ed-868455a8690d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:08:30 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:08:30 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:08:30 user nova-compute[74233]: 
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2386b-5fe4-4bb3-89ac-51bb47abd224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260]
Oct 20 18:08:30 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260] successful.
Oct 20 18:08:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cd97e2-94dd-44ae-9dbb-3990d343eda0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9975df77-85a7-4d9e-b63f-4dfa62d9b6f1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc7027-cfdd-415b-aaea-44cf7c6439f2]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:08:31 user nova-compute[74233]: INFO nova.compute.manager [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] [instance: 52047bb0-5fcf-4de4-851d-c3526ae9ecf9] Took 10.74 seconds to detach 1 volumes for instance.
Oct 20 18:08:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwLPXETS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23432363362373332', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432363362373332', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'flavor' on Instance uuid 4597536a-b485-4bf9-938b-65471258e5e9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:08:31 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:31 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:08:31 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:08:31 user nova-compute[74233]:   <serial>9f014afc-b607-463f-9841-1f68ebd8c918</serial>
Oct 20 18:08:31 user nova-compute[74233]: </disk>
Oct 20 18:08:31 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:32 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Deleted allocations for instance 52047bb0-5fcf-4de4-851d-c3526ae9ecf9
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a51d5273-9a43-4a19-b49e-b178f339a80d tempest-DeleteServersTestJSON-1800105009 tempest-DeleteServersTestJSON-1800105009-project-member] Lock "52047bb0-5fcf-4de4-851d-c3526ae9ecf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.916s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lazy-loading 'flavor' on Instance uuid 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No VIF found with MAC fa:16:3e:5d:2b:59, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syUIKWea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:32 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5091efe-e49c-4713-88eb-96d77be960da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:08:32 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa1c00-6fa8-4e25-9552-2b1ae34b3551]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e] added
Oct 20 18:08:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde96f44-ed7e-493a-a3a3-40a3449a6c1f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f6c3d0-838a-4777-9cbd-bbaa83149f32 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.601s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be1a6f1-bb8c-4b62-98f6-47924e2b32cf]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syUIKWea {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syUIKWea" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[183bacc5-e5f3-4963-abe6-1873a7752645]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syUIKWea'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaff19d1-8df8-4d3c-8008-461f7acc0624]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:32 user nova-compute[74233]: INFO nova.compute.manager [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Attaching volume e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 to /dev/vdb
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e9926d-fe9a-4bee-b5e2-07c231117a74]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b7e9c6-de93-4658-a2e5-7ee70f891cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260]
Oct 20 18:08:33 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260] successful.
Oct 20 18:08:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.utils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45199666-4012-4642-ae50-c95fcdea1b56]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[332d1b99-40c1-4f84-9cf1-4b5e9fa7cde4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8c383-0c31-41eb-a65c-360c343344e5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e70fe8-425c-4d8b-9c72-c475cc4b039d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:33 user nova-compute[74233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)
Oct 20 18:08:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:33 user nova-compute[74233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)
Oct 20 18:08:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2312b9-de45-4f44-bf7d-1c4cd37a9997]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed055741-2f59-434c-9af0-4d0e3d276171]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syUIKWea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c95e9-8ae7-4ab5-9aa6-5dc383df9072]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:33 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:08:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcfa360-4bfd-4bc8-abc8-dfdaced49ebb]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG os_brick.utils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:33 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updating existing volume attachment record: 5b8bb25c-2317-4a47-8140-d3677fdca2f6 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23765326632643530', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765326632643530', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lazy-loading 'flavor' on Instance uuid 5501c668-9766-4290-8152-ee9b0a5b0d89 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:08:34 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:34 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:08:34 user nova-compute[74233]:   <target dev="sdc" bus="scsi"/>
Oct 20 18:08:34 user nova-compute[74233]:   <serial>7a7af421-c8d6-46f9-a2b6-f3f376c9f17e</serial>
Oct 20 18:08:34 user nova-compute[74233]:   <address type="drive" controller="0" unit="2"/>
Oct 20 18:08:34 user nova-compute[74233]: </disk>
Oct 20 18:08:34 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:34 user nova-compute[74233]: INFO nova.compute.manager [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Detaching volume 9f014afc-b607-463f-9841-1f68ebd8c918
Oct 20 18:08:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No BDM found with device name sda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] No VIF found with MAC fa:16:3e:81:ab:73, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:08:35 user nova-compute[74233]: INFO nova.virt.block_device [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Attempting to driver detach volume 9f014afc-b607-463f-9841-1f68ebd8c918 from mountpoint /dev/vdb
Oct 20 18:08:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Attempting to detach device vdb from instance 4597536a-b485-4bf9-938b-65471258e5e9 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:08:35 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:35 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:08:35 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:08:35 user nova-compute[74233]:   <serial>9f014afc-b607-463f-9841-1f68ebd8c918</serial>
Oct 20 18:08:35 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:08:35 user nova-compute[74233]: </disk>
Oct 20 18:08:35 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:08:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Successfully detached device vdb from instance 4597536a-b485-4bf9-938b-65471258e5e9 from the persistent domain config.
Oct 20 18:08:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4597536a-b485-4bf9-938b-65471258e5e9 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:08:35 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:35 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:08:35 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:08:35 user nova-compute[74233]:   <serial>9f014afc-b607-463f-9841-1f68ebd8c918</serial>
Oct 20 18:08:35 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:08:35 user nova-compute[74233]: </disk>
Oct 20 18:08:35 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c8e742c3-3fec-43de-b727-2c87ef943bb1 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.652s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4597536a-b485-4bf9-938b-65471258e5e9 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:08:36 user nova-compute[74233]: INFO nova.compute.claims [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Claim successful on node user
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:08:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.policy [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52a5f40bf784389834d852435a5e757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b618b17f70d4adbb2e54ec79e7b2937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:08:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Creating image(s)
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "/opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "/opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "/opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:36 user nova-compute[74233]: INFO nova.compute.manager [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Detaching volume 7a7af421-c8d6-46f9-a2b6-f3f376c9f17e
Oct 20 18:08:36 user nova-compute[74233]: INFO nova.virt.block_device [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Attempting to driver detach volume 7a7af421-c8d6-46f9-a2b6-f3f376c9f17e from mountpoint /dev/sdc
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Attempting to detach device sdc from instance 5501c668-9766-4290-8152-ee9b0a5b0d89 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:08:36 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:36 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:08:36 user nova-compute[74233]:   <target dev="sdc" bus="scsi"/>
Oct 20 18:08:36 user nova-compute[74233]:   <serial>7a7af421-c8d6-46f9-a2b6-f3f376c9f17e</serial>
Oct 20 18:08:36 user nova-compute[74233]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 18:08:36 user nova-compute[74233]: </disk>
Oct 20 18:08:36 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:08:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Successfully detached device sdc from instance 5501c668-9766-4290-8152-ee9b0a5b0d89 from the persistent domain config.
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5501c668-9766-4290-8152-ee9b0a5b0d89 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:08:36 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:08:36 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:08:36 user nova-compute[74233]:   <target dev="sdc" bus="scsi"/>
Oct 20 18:08:36 user nova-compute[74233]:   <serial>7a7af421-c8d6-46f9-a2b6-f3f376c9f17e</serial>
Oct 20 18:08:36 user nova-compute[74233]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 18:08:36 user nova-compute[74233]: </disk>
Oct 20 18:08:36 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.205s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk 1073741824" returned: 0 in 0.061s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5501c668-9766-4290-8152-ee9b0a5b0d89 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.205s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Successfully created port: 8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Cannot resize image /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Ensure instance console log exists: /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Successfully updated port: 8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquired lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-changed-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Refreshing instance network info cache due to event network-changed-8b1cba4f-5c21-4ca1-acd3-865fb68f060a. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] Acquiring lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updating instance_info_cache with network_info: [{"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Releasing lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Instance network_info: |[{"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] Acquired lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Refreshing network info cache for port 8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Start _get_guest_xml network_info=[{"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:08:38 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:08:38 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1495294645',display_name='tempest-TestServerVolumeAttachmentScenario-server-1495294645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1495294645',id=9,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHc05HvYnkXHyS/avUfjPrXQg3Ap/EYAr3rdFZjx4E9+QQMIgzKahQKW/KupkeoXlkY3ejdiOfsiwIDXtvBWlIMEI9e2ESktrmFYLwlwPHJTnh4FrWCASHldfbOFvN/9g==',key_name='tempest-keypair-1563450852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b618b17f70d4adbb2e54ec79e7b2937',ramdisk_id='',reservation_id='r-iga18hu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1498332361',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1498332361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52a5f40bf784389834d852435a5e757',uuid=833aa705-3460-4831-b6f4-e42e3735eee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Converting VIF {"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'pci_devices' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:08:38 user nova-compute[74233]:   <uuid>833aa705-3460-4831-b6f4-e42e3735eee3</uuid>
Oct 20 18:08:38 user nova-compute[74233]:   <name>instance-00000009</name>
Oct 20 18:08:38 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:08:38 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:08:38 user nova-compute[74233]:   <metadata>
Oct 20 18:08:38 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:08:38 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:08:38 user nova-compute[74233]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1495294645</nova:name>
Oct 20 18:08:38 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:08:38</nova:creationTime>
Oct 20 18:08:38 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:08:38 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:08:38 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:08:38 user nova-compute[74233]:       <nova:owner>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:user uuid="a52a5f40bf784389834d852435a5e757">tempest-TestServerVolumeAttachmentScenario-1498332361-project-member</nova:user>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:project uuid="2b618b17f70d4adbb2e54ec79e7b2937">tempest-TestServerVolumeAttachmentScenario-1498332361</nova:project>
Oct 20 18:08:38 user nova-compute[74233]:       </nova:owner>
Oct 20 18:08:38 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:08:38 user nova-compute[74233]:       <nova:ports>
Oct 20 18:08:38 user nova-compute[74233]:         <nova:port uuid="8b1cba4f-5c21-4ca1-acd3-865fb68f060a">
Oct 20 18:08:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 18:08:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:08:38 user nova-compute[74233]:       </nova:ports>
Oct 20 18:08:38 user nova-compute[74233]:     </nova:instance>
Oct 20 18:08:38 user nova-compute[74233]:   </metadata>
Oct 20 18:08:38 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:08:38 user nova-compute[74233]:     <system>
Oct 20 18:08:38 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:08:38 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:08:38 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:08:38 user nova-compute[74233]:       <entry name="serial">833aa705-3460-4831-b6f4-e42e3735eee3</entry>
Oct 20 18:08:38 user nova-compute[74233]:       <entry name="uuid">833aa705-3460-4831-b6f4-e42e3735eee3</entry>
Oct 20 18:08:38 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:08:38 user nova-compute[74233]:     </system>
Oct 20 18:08:38 user nova-compute[74233]:   </sysinfo>
Oct 20 18:08:38 user nova-compute[74233]:   <os>
Oct 20 18:08:38 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:08:38 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:08:38 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:08:38 user nova-compute[74233]:   </os>
Oct 20 18:08:38 user nova-compute[74233]:   <features>
Oct 20 18:08:38 user nova-compute[74233]:     <acpi/>
Oct 20 18:08:38 user nova-compute[74233]:     <apic/>
Oct 20 18:08:38 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:08:38 user nova-compute[74233]:   </features>
Oct 20 18:08:38 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:08:38 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:08:38 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:08:38 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:08:38 user nova-compute[74233]:   </clock>
Oct 20 18:08:38 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:08:38 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:08:38 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:08:38 user nova-compute[74233]:   </cpu>
Oct 20 18:08:38 user nova-compute[74233]:   <devices>
Oct 20 18:08:38 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:08:38 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:08:38 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk"/>
Oct 20 18:08:38 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:08:38 user nova-compute[74233]:     </disk>
Oct 20 18:08:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:08:38 user nova-compute[74233]:       <mac address="fa:16:3e:6d:6d:46"/>
Oct 20 18:08:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:08:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:08:38 user nova-compute[74233]:       <target dev="tap8b1cba4f-5c"/>
Oct 20 18:08:38 user nova-compute[74233]:     </interface>
Oct 20 18:08:38 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:08:38 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/console.log" append="off"/>
Oct 20 18:08:38 user nova-compute[74233]:     </serial>
Oct 20 18:08:38 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:08:38 user nova-compute[74233]:     <video>
Oct 20 18:08:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:08:38 user nova-compute[74233]:     </video>
Oct 20 18:08:38 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:08:38 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:08:38 user nova-compute[74233]:     </rng>
Oct 20 18:08:38 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:08:38 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:08:38 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:08:38 user nova-compute[74233]:     </memballoon>
Oct 20 18:08:38 user nova-compute[74233]:   </devices>
Oct 20 18:08:38 user nova-compute[74233]: </domain>
Oct 20 18:08:38 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1495294645',display_name='tempest-TestServerVolumeAttachmentScenario-server-1495294645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1495294645',id=9,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHc05HvYnkXHyS/avUfjPrXQg3Ap/EYAr3rdFZjx4E9+QQMIgzKahQKW/KupkeoXlkY3ejdiOfsiwIDXtvBWlIMEI9e2ESktrmFYLwlwPHJTnh4FrWCASHldfbOFvN/9g==',key_name='tempest-keypair-1563450852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b618b17f70d4adbb2e54ec79e7b2937',ramdisk_id='',reservation_id='r-iga18hu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1498332361',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1498332361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52a5f40bf784389834d852435a5e757',uuid=833aa705-3460-4831-b6f4-e42e3735eee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Converting VIF {"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG os_vif [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6313b194-5bf8-5ad8-bf74-2ce3ca76abf0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b1cba4f-5c, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b1cba4f-5c, col_values=(('qos', UUID('32991b79-eab6-4356-b252-08ad2e10ddff')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b1cba4f-5c, col_values=(('external_ids', {'iface-id': '8b1cba4f-5c21-4ca1-acd3-865fb68f060a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:6d:46', 'vm-uuid': '833aa705-3460-4831-b6f4-e42e3735eee3'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:38 user nova-compute[74233]: INFO os_vif [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c')
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:08:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No VIF found with MAC fa:16:3e:6d:6d:46, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:08:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updated VIF entry in instance network info cache for port 8b1cba4f-5c21-4ca1-acd3-865fb68f060a. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:08:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updating instance_info_cache with network_info: [{"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9ff86d5-1396-4041-8134-b082239b6018 req-a495990f-8f44-44b5-a23d-f055d1bec3a1 service nova] Releasing lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-3f928792-6180-44d2-aadb-8c0815722f92 req-b0d73835-ab28-4d6a-a018-70eb91a959f6 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3f928792-6180-44d2-aadb-8c0815722f92 req-b0d73835-ab28-4d6a-a018-70eb91a959f6 service nova] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3f928792-6180-44d2-aadb-8c0815722f92 req-b0d73835-ab28-4d6a-a018-70eb91a959f6 service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3f928792-6180-44d2-aadb-8c0815722f92 req-b0d73835-ab28-4d6a-a018-70eb91a959f6 service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-3f928792-6180-44d2-aadb-8c0815722f92 req-b0d73835-ab28-4d6a-a018-70eb91a959f6 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] No waiting events found dispatching network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:08:40 user nova-compute[74233]: WARNING nova.compute.manager [req-3f928792-6180-44d2-aadb-8c0815722f92 req-b0d73835-ab28-4d6a-a018-70eb91a959f6 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received unexpected event network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a for instance with vm_state building and task_state spawning.
Oct 20 18:08:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-ea065418-0066-4199-aa0a-4008a072f7da req-605be14a-ef05-4d93-9fc7-61cfb2b8de6f service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ea065418-0066-4199-aa0a-4008a072f7da req-605be14a-ef05-4d93-9fc7-61cfb2b8de6f service nova] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ea065418-0066-4199-aa0a-4008a072f7da req-605be14a-ef05-4d93-9fc7-61cfb2b8de6f service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ea065418-0066-4199-aa0a-4008a072f7da req-605be14a-ef05-4d93-9fc7-61cfb2b8de6f service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-ea065418-0066-4199-aa0a-4008a072f7da req-605be14a-ef05-4d93-9fc7-61cfb2b8de6f service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] No waiting events found dispatching network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:08:42 user nova-compute[74233]: WARNING nova.compute.manager [req-ea065418-0066-4199-aa0a-4008a072f7da req-605be14a-ef05-4d93-9fc7-61cfb2b8de6f service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received unexpected event network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a for instance with vm_state building and task_state spawning.
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:08:42 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Instance spawned successfully.
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:08:42 user nova-compute[74233]: INFO nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 20 18:08:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:08:42 user nova-compute[74233]: INFO nova.compute.manager [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Took 7.00 seconds to build instance.
Oct 20 18:08:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab4cdc1-26bf-4a3d-abe3-2f82a141e07c tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.112s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:08:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:45 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:08:45 user nova-compute[74233]: INFO nova.compute.claims [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Claim successful on node user
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:08:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:08:46 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:08:46 user nova-compute[74233]: DEBUG nova.policy [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10447188fbd74b18ba64fc8e64d267c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b592b103d8084815bf6d3132c1215feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:08:46 user nova-compute[74233]: INFO nova.virt.block_device [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Booting with volume snapshot 153b582f-9745-4764-abbf-e91df97cfb7a at /dev/vda
Oct 20 18:08:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Successfully created port: e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:08:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Successfully updated port: e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "refresh_cache-209fbb88-5ad9-4396-8f26-a29616f00e82" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquired lock "refresh_cache-209fbb88-5ad9-4396-8f26-a29616f00e82" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-changed-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Refreshing instance network info cache due to event network-changed-e52539c7-5115-4326-afe9-649918d5bd82. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] Acquiring lock "refresh_cache-209fbb88-5ad9-4396-8f26-a29616f00e82" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Updating instance_info_cache with network_info: [{"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Releasing lock "refresh_cache-209fbb88-5ad9-4396-8f26-a29616f00e82" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Instance network_info: |[{"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] Acquired lock "refresh_cache-209fbb88-5ad9-4396-8f26-a29616f00e82" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Refreshing network info cache for port e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Updated VIF entry in instance network info cache for port e52539c7-5115-4326-afe9-649918d5bd82. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Updating instance_info_cache with network_info: [{"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0b44302-81ee-4abd-a949-e946a505e7ac req-17a7742c-402e-4dff-aa74-ce5055826f2a service nova] Releasing lock "refresh_cache-209fbb88-5ad9-4396-8f26-a29616f00e82" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b450691-52d7-48ba-99f9-2e0bc82fbbc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b814199-cfc4-4747-8e8d-3c91779c3c89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad3d79-da79-4245-b868-e1646a88b693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a28aec-6470-4e18-b07f-63a90a775c50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:08:53 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:08:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13107cda-7c37-49c8-adbd-1aaddc843a86]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Updating existing volume attachment record: 16f70551-5f5c-4b95-a344-dad09ec4a998 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:08:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updating instance_info_cache with network_info: [{"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:08:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4597536a-b485-4bf9-938b-65471258e5e9 is timed out.
Oct 20 18:08:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Successfully detached device vdb from instance 4597536a-b485-4bf9-938b-65471258e5e9 from the live domain config.
Oct 20 18:08:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwLPXETS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:55 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb13bd89-78e1-45cf-aa84-702a419b3327]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:08:55 user nova-compute[74233]: No targets found.
Oct 20 18:08:55 user nova-compute[74233]: iSNS:
Oct 20 18:08:55 user nova-compute[74233]: No targets found.
Oct 20 18:08:55 user nova-compute[74233]: STATIC:
Oct 20 18:08:55 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918
Oct 20 18:08:55 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:08:55 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:08:55 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e
Oct 20 18:08:55 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:08:55 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:08:55 user nova-compute[74233]: FIRMWARE:
Oct 20 18:08:55 user nova-compute[74233]: No targets found.
Oct 20 18:08:55 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:08:55 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:08:55 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a1ede-c429-4994-bd19-95a805888757]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763db0e-3361-424c-bace-0057e1e31339]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:55 user nova-compute[74233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)
Oct 20 18:08:55 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 (non-flash)
Oct 20 18:08:55 user nova-compute[74233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)
Oct 20 18:08:55 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9707cae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b743e1b-487e-4fc4-90b1-aa837ebd1272]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0229acec-42a4-45b4-8378-091f5211dbcc]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[431750b4-33e0-4f61-a720-e327ef8ec25a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6368b3d3-3be1-4676-b979-92d23878cbd2]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe89d9b-739d-41e3-8a66-9cd34889152d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb6b712-5d10-4cc8-b2ec-3564912b27cf]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260]
Oct 20 18:08:56 user nova-compute[74233]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918, portal: 172.16.0.220,3260] successful.
Oct 20 18:08:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f014afc-b607-463f-9841-1f68ebd8c918 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a3975-ec40-49f2-b21e-ce1f496ab663]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] <== disconnect_volume: return (452ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:08:57 user nova-compute[74233]: INFO nova.compute.claims [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Claim successful on node user
Oct 20 18:08:57 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5501c668-9766-4290-8152-ee9b0a5b0d89 is timed out.
Oct 20 18:08:57 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Successfully detached device sdc from instance 5501c668-9766-4290-8152-ee9b0a5b0d89 from the live domain config.
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syUIKWea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:08:57 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59e7c97-0ea1-4427-920c-010a28c61c85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:08:57 user nova-compute[74233]: No targets found.
Oct 20 18:08:57 user nova-compute[74233]: iSNS:
Oct 20 18:08:57 user nova-compute[74233]: No targets found.
Oct 20 18:08:57 user nova-compute[74233]: STATIC:
Oct 20 18:08:57 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e
Oct 20 18:08:57 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:08:57 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:08:57 user nova-compute[74233]: FIRMWARE:
Oct 20 18:08:57 user nova-compute[74233]: No targets found.
Oct 20 18:08:57 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:08:57 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:08:57 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8555a0e3-8fbc-42b2-aa80-48087468d0dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e16c56-f50b-412a-9bd2-b3a0430af38f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)
Oct 20 18:08:57 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e (non-flash)
Oct 20 18:08:57 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb97034fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98076328-4492-49bc-8c3a-0e70063b09f0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee66ea4-8659-4516-94dc-c4a744b991a6]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8ba151-978b-436b-900d-905005d28763]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.110s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a59e30-dfcf-4783-945e-411bccae75f1]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b652f-f6c9-4f14-88cf-74f05542283d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db874c-c9af-4707-ab29-1bab924d82a4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260]
Oct 20 18:08:57 user nova-compute[74233]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e, portal: 172.16.0.220,3260] successful.
Oct 20 18:08:57 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7af421-c8d6-46f9-a2b6-f3f376c9f17e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cedf63-6646-4df0-a4fc-06603e0c86fb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.474s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] <== disconnect_volume: return (477ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.808s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:08:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG nova.policy [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5149d5d6d1f486c87a0c808597a40f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c937ee3474848de8b761d88e32f6447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:08:58 user nova-compute[74233]: INFO nova.virt.block_device [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Booting with blank volume at /dev/vda
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:08:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Successfully created port: e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:59 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:08:59 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7854MB free_disk=25.42770767211914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4597536a-b485-4bf9-938b-65471258e5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5501c668-9766-4290-8152-ee9b0a5b0d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance da89b953-70b8-4c12-b723-8762eb3b70dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 51272c8a-2505-4779-bd9c-af9f352f7b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 833aa705-3460-4831-b6f4-e42e3735eee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 209fbb88-5ad9-4396-8f26-a29616f00e82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Successfully updated port: e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-changed-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Refreshing instance network info cache due to event network-changed-e7731480-1384-4cdd-93e3-f63ae477d471. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] Acquiring lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:08:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance network_info: |[{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] Acquired lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG nova.network.neutron [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Refreshing network info cache for port e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG nova.network.neutron [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updated VIF entry in instance network info cache for port e7731480-1384-4cdd-93e3-f63ae477d471. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG nova.network.neutron [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:09:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23c32925-8b62-4855-ad05-aaee65090ddd req-789ca211-2d37-4b83-83da-1c852e5e2c42 service nova] Releasing lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:09:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:07 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:07 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:07 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[090dbd71-d0da-48ba-9baa-5fb6038cc9d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:09:07 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oUfpWwaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:07 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbbd23c-4efd-4e79-9583-4f23962e7136]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6] added
Oct 20 18:09:07 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6fad8f-247d-4a5d-a57f-cb780478ffe4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f02f3a-48c6-4a40-9fd5-098864979772]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJWPCUMk {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJWPCUMk" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a435b092-5486-4f49-bf4f-9cb027bafb6e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJWPCUMk'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[790cfe85-1f33-4aa3-b4a4-cadb343e8be3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e420a6-39f2-4dfb-92b2-38f612c57461]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:09:07 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:09:07 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:07 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:09:07 user nova-compute[74233]: 
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e29536-8074-4a33-8ae8-aef5a511d9d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]
Oct 20 18:09:07 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:07 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56edb6-7c06-4afc-9dd6-3da1b18ee007]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ac194-0184-4b2f-845c-60f8b52853d9]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:07 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:07 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[762bdd9b-1088-4f6e-9173-fe4310f9a4a1]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:09:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26166396337356638', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166396337356638', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.264s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:08 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:08 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lazy-loading 'flavor' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd7a1ee-1e24-4655-a0c7-b082c0cf42a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:09:08 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:09:08 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:09:08 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:09:08 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:09:08 user nova-compute[74233]:   <serial>027a801e-8dfe-4970-89eb-77f9b334f4a6</serial>
Oct 20 18:09:08 user nova-compute[74233]: </disk>
Oct 20 18:09:08 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d1564-b691-46b5-9deb-dcca5141ef87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6] added
Oct 20 18:09:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG nova.objects.instance [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'flavor' on Instance uuid 4597536a-b485-4bf9-938b-65471258e5e9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22998d4b-6f7b-4cb7-9d1e-4c12db4eed4b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d652a23d-bc02-41b0-b59b-9969b2beb3e0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oUfpWwaF {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40b9b1d9-3369-46d0-8555-4920f9e23b95 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.515s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oUfpWwaF" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca49da-cb25-4c73-8f85-403d93382abc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oUfpWwaF'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[643e4df6-11e3-4c73-9377-356a3698ed5f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd77c81-41b5-4721-a61e-cdebe5a714d4]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4a4b01-dbe3-4fcf-9153-3291c8f16f5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260]
Oct 20 18:09:09 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f803e9-58a6-41cc-af4b-b67fe0af37ca]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[656b27b0-843c-4edf-8442-3e29ed5ce0a9]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:09 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:09 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d961e3-1c86-4899-bd8e-b23743323ec1]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oUfpWwaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] No VIF found with MAC fa:16:3e:ff:20:54, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG nova.objects.instance [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lazy-loading 'flavor' on Instance uuid 5501c668-9766-4290-8152-ee9b0a5b0d89 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-759ae959-88ea-4906-aeba-4740c8a47c91 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.611s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b26e6946-f49f-406f-9a70-1f80c16aa52e tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.357s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] <== connect_volume: return (2592ms) {'type': 'block', 'scsi_wwn': '23734356361303236', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734356361303236', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lazy-loading 'flavor' on Instance uuid 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 18:09:10 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:09:10 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:09:10 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:09:10 user nova-compute[74233]:   <serial>e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6</serial>
Oct 20 18:09:10 user nova-compute[74233]: </disk>
Oct 20 18:09:10 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] No VIF found with MAC fa:16:3e:73:67:56, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc0b215a-4242-47e1-89e7-7fff239a35eb tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.771s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:10 user nova-compute[74233]: INFO nova.compute.manager [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Terminating instance
Oct 20 18:09:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-c8b8bd9c-9a2e-4964-bdd1-a130ad663f96 req-4e9f86d4-4ed4-49a4-a652-275f7441f931 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-vif-unplugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c8b8bd9c-9a2e-4964-bdd1-a130ad663f96 req-4e9f86d4-4ed4-49a4-a652-275f7441f931 service nova] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c8b8bd9c-9a2e-4964-bdd1-a130ad663f96 req-4e9f86d4-4ed4-49a4-a652-275f7441f931 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c8b8bd9c-9a2e-4964-bdd1-a130ad663f96 req-4e9f86d4-4ed4-49a4-a652-275f7441f931 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-c8b8bd9c-9a2e-4964-bdd1-a130ad663f96 req-4e9f86d4-4ed4-49a4-a652-275f7441f931 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] No waiting events found dispatching network-vif-unplugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-c8b8bd9c-9a2e-4964-bdd1-a130ad663f96 req-4e9f86d4-4ed4-49a4-a652-275f7441f931 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-vif-unplugged-e61a576f-6bea-40a1-9968-12245073e169 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_brick.utils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[650a85f1-c0bb-43fc-8f06-2cf3ba60fd45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b4cba8-1ef9-4e70-961c-4b5aea92fced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c9ac8-007b-4ba4-88d2-acd2545edfe2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e85fb5f-605f-47ad-b887-53ebe2e9c03d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:11 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e59e7-d98a-4d4e-b59e-84ae4c8839b1]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_brick.utils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:11 user nova-compute[74233]: INFO nova.compute.manager [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Swapping volume 027a801e-8dfe-4970-89eb-77f9b334f4a6 for d03d2d5e-06e9-4602-9139-4cddd43e9a36
Oct 20 18:09:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Instance destroyed successfully.
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lazy-loading 'resources' on Instance uuid 5501c668-9766-4290-8152-ee9b0a5b0d89 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-574986710',display_name='tempest-AttachSCSIVolumeTestJSON-server-574986710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-574986710',id=6,image_ref='c792114a-c399-4789-9f03-1112e46d2c68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSBkr1BAv0YYB8aCxMp5qBGrQNPzy9uTR3i4NWvgjTxpzVRwzxFwRd+GhPVuEW+YfQCXauRAZz+nKC74HJ9riEWDsx5lqRDlQ63XZP7HipbezHmuaq+IwSdQrWA9lnEDQ==',key_name='tempest-keypair-1205028556',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c89381edff924c5fa093f25e2e2d371f',ramdisk_id='',reservation_id='r-o4a0ty6l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c792114a-c399-4789-9f03-1112e46d2c68',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-828755762',owner_user_name='tempest-AttachSCSIVolumeTestJSON-828755762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='492278c0179f4b3592128bf856a8c30d',uuid=5501c668-9766-4290-8152-ee9b0a5b0d89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Converting VIF {"id": "e61a576f-6bea-40a1-9968-12245073e169", "address": "fa:16:3e:81:ab:73", "network": {"id": "81665e30-0c26-446f-a057-9a9f3f177bf2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-761555103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c89381edff924c5fa093f25e2e2d371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61a576f-6b", "ovs_interfaceid": "e61a576f-6bea-40a1-9968-12245073e169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG os_vif [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape61a576f-6b, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9dad397-db3b-4c58-88d2-a101860222f9) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:11 user nova-compute[74233]: INFO os_vif [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=e61a576f-6bea-40a1-9968-12245073e169,network=Network(81665e30-0c26-446f-a057-9a9f3f177bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61a576f-6b')
Oct 20 18:09:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Deleting instance files /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89_del
Oct 20 18:09:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Deletion of /opt/stack/data/nova/instances/5501c668-9766-4290-8152-ee9b0a5b0d89_del complete
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] volume_snapshot_create: create_info: {'snapshot_id': '003adb65-b4a7-48be-b62f-68f7b9247785', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74233) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] snap xml: <domainsnapshot>
Oct 20 18:09:11 user nova-compute[74233]:   <disks>
Oct 20 18:09:11 user nova-compute[74233]:     <disk name="/dev/sdc" snapshot="external" type="file">
Oct 20 18:09:11 user nova-compute[74233]:       <source file="/dev/new_file"/>
Oct 20 18:09:11 user nova-compute[74233]:     </disk>
Oct 20 18:09:11 user nova-compute[74233]:     <disk name="vda" snapshot="no"/>
Oct 20 18:09:11 user nova-compute[74233]:   </disks>
Oct 20 18:09:11 user nova-compute[74233]: </domainsnapshot>
Oct 20 18:09:11 user nova-compute[74233]:  {{(pid=74233) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] Lazy-loading 'system_metadata' on Instance uuid 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:11 user nova-compute[74233]: INFO nova.compute.manager [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 18:09:11 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:09:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-16ef5ef8-4045-4ab4-96d2-b01087192bba tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] volume_snapshot_delete: delete_info: {'volume_id': 'e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6'} {{(pid=74233) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [None req-16ef5ef8-4045-4ab4-96d2-b01087192bba tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     if delete_info['type'] != 'qcow2':
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] KeyError: 'type'
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] 
Oct 20 18:09:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     rv = execute(f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     six.reraise(c, e, tb)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     raise value
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     rv = meth(*args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     self._volume_snapshot_create(context, instance, guest,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     rv = execute(f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     six.reraise(c, e, tb)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     raise value
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     rv = meth(*args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [None req-16ef5ef8-4045-4ab4-96d2-b01087192bba tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a6d67811-a407-4c8e-b7af-d19f12877685)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server [None req-16ef5ef8-4045-4ab4-96d2-b01087192bba tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] Exception during message handling: KeyError: 'type'
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 003adb65-b4a7-48be-b62f-68f7b9247785 could not be found.
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 003adb65-b4a7-48be-b62f-68f7b9247785 could not be found. (HTTP 404) (Request-ID: req-de5e6233-f6ab-4dc1-91be-8b66d23d82d7)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 003adb65-b4a7-48be-b62f-68f7b9247785 could not be found.
Oct 20 18:09:11 user nova-compute[74233]: ERROR nova.virt.libvirt.driver 
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server [None req-ab55b2ca-0acd-4845-94e0-6bd2f2f2c089 tempest-VolumesAssistedSnapshotsTest-658433112 tempest-VolumesAssistedSnapshotsTest-658433112-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 18:09:11 user nova-compute[74233]: ERROR oslo_messaging.rpc.server 
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:12 user nova-compute[74233]: INFO nova.compute.manager [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Detaching volume e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6
Oct 20 18:09:12 user nova-compute[74233]: INFO nova.virt.block_device [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Attempting to driver detach volume e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 from mountpoint /dev/vdb
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:09:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Creating image(s)
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Ensure instance console log exists: /opt/stack/data/nova/instances/209fbb88-5ad9-4396-8f26-a29616f00e82/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Start _get_guest_xml network_info=[{"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '16f70551-5f5c-4b95-a344-dad09ec4a998', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqfaMpRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '209fbb88-5ad9-4396-8f26-a29616f00e82', 'attached_at': '', 'detached_at': '', 'volume_id': '45caf46c-e730-4573-8ded-2636ce5aa1b8', 'serial': '45caf46c-e730-4573-8ded-2636ce5aa1b8'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:09:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Attempting to detach device vdb from instance 51272c8a-2505-4779-bd9c-af9f352f7b7b from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 18:09:12 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:09:12 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:09:12 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:09:12 user nova-compute[74233]:   <serial>e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6</serial>
Oct 20 18:09:12 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:09:12 user nova-compute[74233]: </disk>
Oct 20 18:09:12 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqfaMpRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:12 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Successfully detached device vdb from instance 51272c8a-2505-4779-bd9c-af9f352f7b7b from the persistent domain config.
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51272c8a-2505-4779-bd9c-af9f352f7b7b from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 18:09:12 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:09:12 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:09:12 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:09:12 user nova-compute[74233]:   <serial>e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6</serial>
Oct 20 18:09:12 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:09:12 user nova-compute[74233]: </disk>
Oct 20 18:09:12 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1601475-9138-47f2-9b00-65a60e095436]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:09:12 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8828effc-e26d-4620-80ab-3c693722a2d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8] added
Oct 20 18:09:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[42020df8-6757-4c30-85ca-e85698c9ab9e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22936c83-8369-4f0d-a31f-3ba20ad7a98b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqfaMpRZ {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqfaMpRZ" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7cacbd-b040-46dd-a963-7d53ac61c0b9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FqfaMpRZ'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c98e5-3799-4218-a4b1-7951547135a4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad8822-459d-482d-80aa-18ef6321b350]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad062f8-6f58-4380-a9e2-d777114feaa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260]
Oct 20 18:09:13 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:13 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Took 1.34 seconds to deallocate network for instance.
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51bf6cf-2889-4502-8d55-45bc5c0ea486]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b808122-fcee-4a6e-aecd-38007c8010fb]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b04afda-d0d9-4e12-9cf1-654bfb0e1a3b]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqfaMpRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] Acquiring lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] No waiting events found dispatching network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:13 user nova-compute[74233]: WARNING nova.compute.manager [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received unexpected event network-vif-plugged-e61a576f-6bea-40a1-9968-12245073e169 for instance with vm_state deleted and task_state None.
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-38941e70-b1fd-4f59-9bf4-03a994689915 req-370f7a83-04f7-4520-95ad-b3a800dd3ca0 service nova] [instance: 5501c668-9766-4290-8152-ee9b0a5b0d89] Received event network-vif-deleted-e61a576f-6bea-40a1-9968-12245073e169 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:13 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Deleted allocations for instance 5501c668-9766-4290-8152-ee9b0a5b0d89
Oct 20 18:09:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d106c52-926a-4728-a08d-d32d35e1d541 tempest-AttachSCSIVolumeTestJSON-828755762 tempest-AttachSCSIVolumeTestJSON-828755762-project-member] Lock "5501c668-9766-4290-8152-ee9b0a5b0d89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23362393164303164', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362393164303164', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1858684839',display_name='tempest-TestVolumeBootPattern-server-1858684839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1858684839',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-ggfa0clj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:08:47Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=209fbb88-5ad9-4396-8f26-a29616f00e82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'pci_devices' on Instance uuid 209fbb88-5ad9-4396-8f26-a29616f00e82 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:09:14 user nova-compute[74233]:   <uuid>209fbb88-5ad9-4396-8f26-a29616f00e82</uuid>
Oct 20 18:09:14 user nova-compute[74233]:   <name>instance-0000000a</name>
Oct 20 18:09:14 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:09:14 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:09:14 user nova-compute[74233]:   <metadata>
Oct 20 18:09:14 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:09:14 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:09:14 user nova-compute[74233]:       <nova:name>tempest-TestVolumeBootPattern-server-1858684839</nova:name>
Oct 20 18:09:14 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:09:12</nova:creationTime>
Oct 20 18:09:14 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:09:14 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:09:14 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:09:14 user nova-compute[74233]:       <nova:owner>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:user uuid="10447188fbd74b18ba64fc8e64d267c6">tempest-TestVolumeBootPattern-2006411708-project-member</nova:user>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:project uuid="b592b103d8084815bf6d3132c1215feb">tempest-TestVolumeBootPattern-2006411708</nova:project>
Oct 20 18:09:14 user nova-compute[74233]:       </nova:owner>
Oct 20 18:09:14 user nova-compute[74233]:       <nova:ports>
Oct 20 18:09:14 user nova-compute[74233]:         <nova:port uuid="e52539c7-5115-4326-afe9-649918d5bd82">
Oct 20 18:09:14 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 18:09:14 user nova-compute[74233]:         </nova:port>
Oct 20 18:09:14 user nova-compute[74233]:       </nova:ports>
Oct 20 18:09:14 user nova-compute[74233]:     </nova:instance>
Oct 20 18:09:14 user nova-compute[74233]:   </metadata>
Oct 20 18:09:14 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:09:14 user nova-compute[74233]:     <system>
Oct 20 18:09:14 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:09:14 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:09:14 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:09:14 user nova-compute[74233]:       <entry name="serial">209fbb88-5ad9-4396-8f26-a29616f00e82</entry>
Oct 20 18:09:14 user nova-compute[74233]:       <entry name="uuid">209fbb88-5ad9-4396-8f26-a29616f00e82</entry>
Oct 20 18:09:14 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:09:14 user nova-compute[74233]:     </system>
Oct 20 18:09:14 user nova-compute[74233]:   </sysinfo>
Oct 20 18:09:14 user nova-compute[74233]:   <os>
Oct 20 18:09:14 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:09:14 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:09:14 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:09:14 user nova-compute[74233]:   </os>
Oct 20 18:09:14 user nova-compute[74233]:   <features>
Oct 20 18:09:14 user nova-compute[74233]:     <acpi/>
Oct 20 18:09:14 user nova-compute[74233]:     <apic/>
Oct 20 18:09:14 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:09:14 user nova-compute[74233]:   </features>
Oct 20 18:09:14 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:09:14 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:09:14 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:09:14 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:09:14 user nova-compute[74233]:   </clock>
Oct 20 18:09:14 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:09:14 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:09:14 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:09:14 user nova-compute[74233]:   </cpu>
Oct 20 18:09:14 user nova-compute[74233]:   <devices>
Oct 20 18:09:14 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:09:14 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:09:14 user nova-compute[74233]:       <source dev="/dev/sdd"/>
Oct 20 18:09:14 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:09:14 user nova-compute[74233]:       <serial>45caf46c-e730-4573-8ded-2636ce5aa1b8</serial>
Oct 20 18:09:14 user nova-compute[74233]:     </disk>
Oct 20 18:09:14 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:09:14 user nova-compute[74233]:       <mac address="fa:16:3e:b5:f9:1b"/>
Oct 20 18:09:14 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:09:14 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:09:14 user nova-compute[74233]:       <target dev="tape52539c7-51"/>
Oct 20 18:09:14 user nova-compute[74233]:     </interface>
Oct 20 18:09:14 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:09:14 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/209fbb88-5ad9-4396-8f26-a29616f00e82/console.log" append="off"/>
Oct 20 18:09:14 user nova-compute[74233]:     </serial>
Oct 20 18:09:14 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:09:14 user nova-compute[74233]:     <video>
Oct 20 18:09:14 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:09:14 user nova-compute[74233]:     </video>
Oct 20 18:09:14 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:09:14 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:09:14 user nova-compute[74233]:     </rng>
Oct 20 18:09:14 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:09:14 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:09:14 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:09:14 user nova-compute[74233]:     </memballoon>
Oct 20 18:09:14 user nova-compute[74233]:   </devices>
Oct 20 18:09:14 user nova-compute[74233]: </domain>
Oct 20 18:09:14 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1858684839',display_name='tempest-TestVolumeBootPattern-server-1858684839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1858684839',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-ggfa0clj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:08:47Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=209fbb88-5ad9-4396-8f26-a29616f00e82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_vif [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '081ea88a-4ca9-5b4d-b4b8-d9d7d3ebeaf6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape52539c7-51, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape52539c7-51, col_values=(('qos', UUID('db993578-6f88-49af-ba1a-7ab87cb1947f')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape52539c7-51, col_values=(('external_ids', {'iface-id': 'e52539c7-5115-4326-afe9-649918d5bd82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:f9:1b', 'vm-uuid': '209fbb88-5ad9-4396-8f26-a29616f00e82'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: INFO os_vif [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51')
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No VIF found with MAC fa:16:3e:b5:f9:1b, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.utils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0191b0-8a66-4de6-b7b8-b242d2c4d923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4809d8-586b-42d8-96fc-d222f9b4f23e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a48a3b-1331-4dd2-bfc7-9ec7bd677608]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a081ca6-9a08-4f4b-956c-2693d0ce00f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:14 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:09:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6d203-cdc7-4d5e-b50e-b502f5cdf898]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG os_brick.utils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:14 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating existing volume attachment record: 7b26a147-538e-4bc2-9458-ebde369e6eca {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-bb45aa29-d0d4-4f79-b780-f8ac3b081e81 req-3a9d659e-328b-4a24-be1c-5d95e886236e service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bb45aa29-d0d4-4f79-b780-f8ac3b081e81 req-3a9d659e-328b-4a24-be1c-5d95e886236e service nova] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bb45aa29-d0d4-4f79-b780-f8ac3b081e81 req-3a9d659e-328b-4a24-be1c-5d95e886236e service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bb45aa29-d0d4-4f79-b780-f8ac3b081e81 req-3a9d659e-328b-4a24-be1c-5d95e886236e service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-bb45aa29-d0d4-4f79-b780-f8ac3b081e81 req-3a9d659e-328b-4a24-be1c-5d95e886236e service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] No waiting events found dispatching network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:15 user nova-compute[74233]: WARNING nova.compute.manager [req-bb45aa29-d0d4-4f79-b780-f8ac3b081e81 req-3a9d659e-328b-4a24-be1c-5d95e886236e service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received unexpected event network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 for instance with vm_state building and task_state spawning.
Oct 20 18:09:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-6229deb3-9c2e-4e0f-aab5-0deec02cd7f3 req-297c457a-5d16-415e-9c3a-25614052a357 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6229deb3-9c2e-4e0f-aab5-0deec02cd7f3 req-297c457a-5d16-415e-9c3a-25614052a357 service nova] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6229deb3-9c2e-4e0f-aab5-0deec02cd7f3 req-297c457a-5d16-415e-9c3a-25614052a357 service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6229deb3-9c2e-4e0f-aab5-0deec02cd7f3 req-297c457a-5d16-415e-9c3a-25614052a357 service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-6229deb3-9c2e-4e0f-aab5-0deec02cd7f3 req-297c457a-5d16-415e-9c3a-25614052a357 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] No waiting events found dispatching network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:18 user nova-compute[74233]: WARNING nova.compute.manager [req-6229deb3-9c2e-4e0f-aab5-0deec02cd7f3 req-297c457a-5d16-415e-9c3a-25614052a357 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received unexpected event network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 for instance with vm_state building and task_state spawning.
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:09:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Instance spawned successfully.
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:18 user nova-compute[74233]: INFO nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 20 18:09:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:09:18 user nova-compute[74233]: INFO nova.compute.manager [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Took 32.58 seconds to build instance.
Oct 20 18:09:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e7bb2438-af6e-4749-95e9-e7e0e45e39ed tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.704s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:09:26 user nova-compute[74233]: INFO nova.compute.claims [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Claim successful on node user
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:09:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:09:26 user nova-compute[74233]: DEBUG nova.policy [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4c6280b548459599c60b88672a963c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2110b7ff17d146d1b97f0daea38053f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:09:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Creating image(s)
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "/opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "/opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk 1073741824" returned: 0 in 0.061s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Successfully created port: b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Cannot resize image /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Ensure instance console log exists: /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Successfully updated port: b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "refresh_cache-a9a937ea-ccd4-4502-b13b-09dda73e4156" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquired lock "refresh_cache-a9a937ea-ccd4-4502-b13b-09dda73e4156" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-changed-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Refreshing instance network info cache due to event network-changed-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] Acquiring lock "refresh_cache-a9a937ea-ccd4-4502-b13b-09dda73e4156" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Updating instance_info_cache with network_info: [{"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Releasing lock "refresh_cache-a9a937ea-ccd4-4502-b13b-09dda73e4156" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Instance network_info: |[{"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] Acquired lock "refresh_cache-a9a937ea-ccd4-4502-b13b-09dda73e4156" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Refreshing network info cache for port b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Start _get_guest_xml network_info=[{"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:09:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-907902911',display_name='tempest-VolumesAdminNegativeTest-server-907902911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-907902911',id=12,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2110b7ff17d146d1b97f0daea38053f2',ramdisk_id='',reservation_id='r-7c094hjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-842591383',owner_user_name='tempest-VolumesAdminNegativeTest-842591383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:09:27Z,user_data=None,user_id='ef4c6280b548459599c60b88672a963c',uuid=a9a937ea-ccd4-4502-b13b-09dda73e4156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converting VIF {"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'pci_devices' on Instance uuid a9a937ea-ccd4-4502-b13b-09dda73e4156 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:09:28 user nova-compute[74233]:   <uuid>a9a937ea-ccd4-4502-b13b-09dda73e4156</uuid>
Oct 20 18:09:28 user nova-compute[74233]:   <name>instance-0000000c</name>
Oct 20 18:09:28 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:09:28 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:09:28 user nova-compute[74233]:   <metadata>
Oct 20 18:09:28 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:09:28 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:09:28 user nova-compute[74233]:       <nova:name>tempest-VolumesAdminNegativeTest-server-907902911</nova:name>
Oct 20 18:09:28 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:09:28</nova:creationTime>
Oct 20 18:09:28 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:09:28 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:09:28 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:09:28 user nova-compute[74233]:       <nova:owner>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:user uuid="ef4c6280b548459599c60b88672a963c">tempest-VolumesAdminNegativeTest-842591383-project-member</nova:user>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:project uuid="2110b7ff17d146d1b97f0daea38053f2">tempest-VolumesAdminNegativeTest-842591383</nova:project>
Oct 20 18:09:28 user nova-compute[74233]:       </nova:owner>
Oct 20 18:09:28 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:09:28 user nova-compute[74233]:       <nova:ports>
Oct 20 18:09:28 user nova-compute[74233]:         <nova:port uuid="b96d6831-a11c-47e3-a9c7-ed2529ba1cb7">
Oct 20 18:09:28 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:09:28 user nova-compute[74233]:         </nova:port>
Oct 20 18:09:28 user nova-compute[74233]:       </nova:ports>
Oct 20 18:09:28 user nova-compute[74233]:     </nova:instance>
Oct 20 18:09:28 user nova-compute[74233]:   </metadata>
Oct 20 18:09:28 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:09:28 user nova-compute[74233]:     <system>
Oct 20 18:09:28 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:09:28 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:09:28 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:09:28 user nova-compute[74233]:       <entry name="serial">a9a937ea-ccd4-4502-b13b-09dda73e4156</entry>
Oct 20 18:09:28 user nova-compute[74233]:       <entry name="uuid">a9a937ea-ccd4-4502-b13b-09dda73e4156</entry>
Oct 20 18:09:28 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:09:28 user nova-compute[74233]:     </system>
Oct 20 18:09:28 user nova-compute[74233]:   </sysinfo>
Oct 20 18:09:28 user nova-compute[74233]:   <os>
Oct 20 18:09:28 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:09:28 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:09:28 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:09:28 user nova-compute[74233]:   </os>
Oct 20 18:09:28 user nova-compute[74233]:   <features>
Oct 20 18:09:28 user nova-compute[74233]:     <acpi/>
Oct 20 18:09:28 user nova-compute[74233]:     <apic/>
Oct 20 18:09:28 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:09:28 user nova-compute[74233]:   </features>
Oct 20 18:09:28 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:09:28 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:09:28 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:09:28 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:09:28 user nova-compute[74233]:   </clock>
Oct 20 18:09:28 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:09:28 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:09:28 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:09:28 user nova-compute[74233]:   </cpu>
Oct 20 18:09:28 user nova-compute[74233]:   <devices>
Oct 20 18:09:28 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:09:28 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:09:28 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk"/>
Oct 20 18:09:28 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:09:28 user nova-compute[74233]:     </disk>
Oct 20 18:09:28 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:09:28 user nova-compute[74233]:       <mac address="fa:16:3e:ed:f7:dc"/>
Oct 20 18:09:28 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:09:28 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:09:28 user nova-compute[74233]:       <target dev="tapb96d6831-a1"/>
Oct 20 18:09:28 user nova-compute[74233]:     </interface>
Oct 20 18:09:28 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:09:28 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/console.log" append="off"/>
Oct 20 18:09:28 user nova-compute[74233]:     </serial>
Oct 20 18:09:28 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:09:28 user nova-compute[74233]:     <video>
Oct 20 18:09:28 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:09:28 user nova-compute[74233]:     </video>
Oct 20 18:09:28 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:09:28 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:09:28 user nova-compute[74233]:     </rng>
Oct 20 18:09:28 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:09:28 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:09:28 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:09:28 user nova-compute[74233]:     </memballoon>
Oct 20 18:09:28 user nova-compute[74233]:   </devices>
Oct 20 18:09:28 user nova-compute[74233]: </domain>
Oct 20 18:09:28 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-907902911',display_name='tempest-VolumesAdminNegativeTest-server-907902911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-907902911',id=12,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2110b7ff17d146d1b97f0daea38053f2',ramdisk_id='',reservation_id='r-7c094hjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-842591383',owner_user_name='tempest-VolumesAdminNegativeTest-842591383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:09:27Z,user_data=None,user_id='ef4c6280b548459599c60b88672a963c',uuid=a9a937ea-ccd4-4502-b13b-09dda73e4156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converting VIF {"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG os_vif [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a32ef8e-d510-5c61-bf51-a8132b78791b', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb96d6831-a1, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb96d6831-a1, col_values=(('qos', UUID('2d3fa7b3-65c9-4583-9b09-442276f7207f')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb96d6831-a1, col_values=(('external_ids', {'iface-id': 'b96d6831-a11c-47e3-a9c7-ed2529ba1cb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f7:dc', 'vm-uuid': 'a9a937ea-ccd4-4502-b13b-09dda73e4156'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:28 user nova-compute[74233]: INFO os_vif [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1')
Oct 20 18:09:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] No VIF found with MAC fa:16:3e:ed:f7:dc, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:09:29 user nova-compute[74233]: DEBUG nova.network.neutron [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Updated VIF entry in instance network info cache for port b96d6831-a11c-47e3-a9c7-ed2529ba1cb7. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:09:29 user nova-compute[74233]: DEBUG nova.network.neutron [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Updating instance_info_cache with network_info: [{"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:09:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9984141-656a-47d8-9438-affe6071d5e5 req-f20b60d7-718a-4c29-8e0c-0ed996cbe7eb service nova] Releasing lock "refresh_cache-a9a937ea-ccd4-4502-b13b-09dda73e4156" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:09:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-b64c2c02-0a86-4117-917d-e9cbbb1b730c req-3379d49a-839f-4e91-996e-d1e7ca81e500 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b64c2c02-0a86-4117-917d-e9cbbb1b730c req-3379d49a-839f-4e91-996e-d1e7ca81e500 service nova] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b64c2c02-0a86-4117-917d-e9cbbb1b730c req-3379d49a-839f-4e91-996e-d1e7ca81e500 service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b64c2c02-0a86-4117-917d-e9cbbb1b730c req-3379d49a-839f-4e91-996e-d1e7ca81e500 service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-b64c2c02-0a86-4117-917d-e9cbbb1b730c req-3379d49a-839f-4e91-996e-d1e7ca81e500 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] No waiting events found dispatching network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:31 user nova-compute[74233]: WARNING nova.compute.manager [req-b64c2c02-0a86-4117-917d-e9cbbb1b730c req-3379d49a-839f-4e91-996e-d1e7ca81e500 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received unexpected event network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 for instance with vm_state building and task_state spawning.
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:09:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Instance spawned successfully.
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:33 user nova-compute[74233]: INFO nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Took 6.01 seconds to spawn the instance on the hypervisor.
Oct 20 18:09:33 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-5374daef-2726-46a5-a3fe-2894e427026a req-9767f574-6ef5-426b-9906-041e710435c7 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5374daef-2726-46a5-a3fe-2894e427026a req-9767f574-6ef5-426b-9906-041e710435c7 service nova] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5374daef-2726-46a5-a3fe-2894e427026a req-9767f574-6ef5-426b-9906-041e710435c7 service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5374daef-2726-46a5-a3fe-2894e427026a req-9767f574-6ef5-426b-9906-041e710435c7 service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-5374daef-2726-46a5-a3fe-2894e427026a req-9767f574-6ef5-426b-9906-041e710435c7 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] No waiting events found dispatching network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:33 user nova-compute[74233]: WARNING nova.compute.manager [req-5374daef-2726-46a5-a3fe-2894e427026a req-9767f574-6ef5-426b-9906-041e710435c7 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received unexpected event network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 for instance with vm_state building and task_state spawning.
Oct 20 18:09:33 user nova-compute[74233]: DEBUG nova.compute.manager [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whFKLdot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da89b953-70b8-4c12-b723-8762eb3b70dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36', 'serial': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'da89b953-70b8-4c12-b723-8762eb3b70dd', 'attached_at': '', 'detached_at': '', 'volume_id': '027a801e-8dfe-4970-89eb-77f9b334f4a6', 'serial'} {{(pid=74233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 18:09:33 user nova-compute[74233]: INFO nova.compute.manager [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Took 7.05 seconds to build instance.
Oct 20 18:09:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whFKLdot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:33 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ac0dcdd-05a6-49a3-abe7-8e3b008541ee tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.190s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ec13f-925e-4f88-aa54-38c20734fe83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:09:33 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c25fbb-24ea-4958-9b1e-7d307a4f3386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36] added
Oct 20 18:09:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b175922f-2b5c-4cdf-912b-460eba4a174d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92828c8-2a0b-4751-a2dd-eaa915cf730c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whFKLdot {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whFKLdot" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47060dbd-f99c-4cb7-8318-54176f729adc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'whFKLdot'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51272c8a-2505-4779-bd9c-af9f352f7b7b is timed out.
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5a72b7-bae4-4a73-81b8-f174eb2f4ded]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Successfully detached device vdb from instance 51272c8a-2505-4779-bd9c-af9f352f7b7b from the live domain config.
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oUfpWwaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad08a0-f38b-4d7d-ba81-b0b0b473817e]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce71c4aa-b64f-46c4-9f3d-930257ffe1d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260]
Oct 20 18:09:33 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.047s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d167e9-689b-4911-ac5a-7b4744ac3280]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb65af3-1934-44e7-8c00-e23ffae5e46a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.514s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75130cad-4adf-4359-b013-063d0b4eac17]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whFKLdot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:09:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.588s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] <== connect_volume: return (1591ms) {'type': 'block', 'scsi_wwn': '26538633337633139', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538633337633139', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.354s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG nova.objects.instance [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lazy-loading 'flavor' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0913e9f-19ce-472c-8d3a-da8155136af1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:09:34 user nova-compute[74233]: No targets found.
Oct 20 18:09:34 user nova-compute[74233]: iSNS:
Oct 20 18:09:34 user nova-compute[74233]: No targets found.
Oct 20 18:09:34 user nova-compute[74233]: STATIC:
Oct 20 18:09:34 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36
Oct 20 18:09:34 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:34 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:34 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8
Oct 20 18:09:34 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:34 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:34 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6
Oct 20 18:09:34 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:34 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:34 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:09:34 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:34 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:34 user nova-compute[74233]: FIRMWARE:
Oct 20 18:09:34 user nova-compute[74233]: No targets found.
Oct 20 18:09:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:09:34 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:09:34 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80efa41-e0e9-4356-a159-ac05fa060523]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e67d93-c5f4-430e-8081-0cbffee65f7a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb980146710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf49a33-3b68-4ebb-8d18-4a82abc38c39]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8887a7f-046f-4555-a2e6-1f487009fd3f]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f992cca9-02aa-49bb-991e-0d3538437dfe]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:09:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733c5db-77b0-4ece-b0a4-d023c587d0f5]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2cc4b8-fb4f-421b-8430-2a8c0a5516e0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19f01a-42d4-45a4-9109-63fb9ed33b7f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260]
Oct 20 18:09:35 user nova-compute[74233]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05a8c22-9f5f-45e1-ab95-fd3f9bbe86c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e483918b-a9bf-4e3d-b9f4-f298fbe245c6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] <== disconnect_volume: return (1698ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 68157440 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:09:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Creating image(s)
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Ensure instance console log exists: /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Start _get_guest_xml network_info=[{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '7b26a147-538e-4bc2-9458-ebde369e6eca', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95824943-b9d7-4a42-ba57-56ff4aad7142', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7995a08-6018-45ef-89cd-d30bcfb34fb3', 'serial': 'd7995a08-6018-45ef-89cd-d30bcfb34fb3'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:09:35 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:35 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:09:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:36 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515a86e-95ea-426f-a047-627a2610a0f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:09:36 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[59050eb3-6d4e-4d1e-b655-8411347c6e79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3] added
Oct 20 18:09:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc2f6b-0945-48f8-b51d-4b54a8e97a25]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa45aaf-963c-4f72-9fdf-d1688da82fc3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjDxINpY {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjDxINpY" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c368aba-e82d-403c-ba3c-02ccba039f80]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjDxINpY'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b19bd-61f7-444c-8d00-17ceb1cd83c4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab664c6b-6cc3-4b74-bcd4-ef75237c08d7]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1715c8a-d3e7-45df-b731-b00b11d6ba59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260]
Oct 20 18:09:36 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e173370e-51c7-4ff1-b2d1-f81f1d82a87f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf7c55-bd2a-44fd-a109-5ac5c0602dae]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:09:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b76630-3dfc-4629-8ef5-1ba0ebacb474]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.objects.instance [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lazy-loading 'flavor' on Instance uuid 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-84022a06-d965-4f5a-9a6e-a7d3532fc273 tempest-VolumesAssistedSnapshotsTest-626525161 tempest-VolumesAssistedSnapshotsTest-626525161-project-admin] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.143s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 316669952 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 436207616 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== connect_volume: return (1533ms) {'type': 'block', 'scsi_wwn': '23061613937336265', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061613937336265', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114649267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114649267',id=11,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-erxct8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:08:58Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=95824943-b9d7-4a42-ba57-56ff4aad7142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'pci_devices' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:09:37 user nova-compute[74233]:   <uuid>95824943-b9d7-4a42-ba57-56ff4aad7142</uuid>
Oct 20 18:09:37 user nova-compute[74233]:   <name>instance-0000000b</name>
Oct 20 18:09:37 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:09:37 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:09:37 user nova-compute[74233]:   <metadata>
Oct 20 18:09:37 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:09:37 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:09:37 user nova-compute[74233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2114649267</nova:name>
Oct 20 18:09:37 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:09:35</nova:creationTime>
Oct 20 18:09:37 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:09:37 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:09:37 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:09:37 user nova-compute[74233]:       <nova:owner>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:user uuid="a5149d5d6d1f486c87a0c808597a40f3">tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member</nova:user>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:project uuid="8c937ee3474848de8b761d88e32f6447">tempest-ServerBootFromVolumeStableRescueTest-481267461</nova:project>
Oct 20 18:09:37 user nova-compute[74233]:       </nova:owner>
Oct 20 18:09:37 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:09:37 user nova-compute[74233]:       <nova:ports>
Oct 20 18:09:37 user nova-compute[74233]:         <nova:port uuid="e7731480-1384-4cdd-93e3-f63ae477d471">
Oct 20 18:09:37 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:09:37 user nova-compute[74233]:         </nova:port>
Oct 20 18:09:37 user nova-compute[74233]:       </nova:ports>
Oct 20 18:09:37 user nova-compute[74233]:     </nova:instance>
Oct 20 18:09:37 user nova-compute[74233]:   </metadata>
Oct 20 18:09:37 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:09:37 user nova-compute[74233]:     <system>
Oct 20 18:09:37 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:09:37 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:09:37 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:09:37 user nova-compute[74233]:       <entry name="serial">95824943-b9d7-4a42-ba57-56ff4aad7142</entry>
Oct 20 18:09:37 user nova-compute[74233]:       <entry name="uuid">95824943-b9d7-4a42-ba57-56ff4aad7142</entry>
Oct 20 18:09:37 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:09:37 user nova-compute[74233]:     </system>
Oct 20 18:09:37 user nova-compute[74233]:   </sysinfo>
Oct 20 18:09:37 user nova-compute[74233]:   <os>
Oct 20 18:09:37 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:09:37 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:09:37 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:09:37 user nova-compute[74233]:   </os>
Oct 20 18:09:37 user nova-compute[74233]:   <features>
Oct 20 18:09:37 user nova-compute[74233]:     <acpi/>
Oct 20 18:09:37 user nova-compute[74233]:     <apic/>
Oct 20 18:09:37 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:09:37 user nova-compute[74233]:   </features>
Oct 20 18:09:37 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:09:37 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:09:37 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:09:37 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:09:37 user nova-compute[74233]:   </clock>
Oct 20 18:09:37 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:09:37 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:09:37 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:09:37 user nova-compute[74233]:   </cpu>
Oct 20 18:09:37 user nova-compute[74233]:   <devices>
Oct 20 18:09:37 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:09:37 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:09:37 user nova-compute[74233]:       <source dev="/dev/sdc"/>
Oct 20 18:09:37 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:09:37 user nova-compute[74233]:       <serial>d7995a08-6018-45ef-89cd-d30bcfb34fb3</serial>
Oct 20 18:09:37 user nova-compute[74233]:     </disk>
Oct 20 18:09:37 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:09:37 user nova-compute[74233]:       <mac address="fa:16:3e:7d:76:a1"/>
Oct 20 18:09:37 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:09:37 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:09:37 user nova-compute[74233]:       <target dev="tape7731480-13"/>
Oct 20 18:09:37 user nova-compute[74233]:     </interface>
Oct 20 18:09:37 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:09:37 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/console.log" append="off"/>
Oct 20 18:09:37 user nova-compute[74233]:     </serial>
Oct 20 18:09:37 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:09:37 user nova-compute[74233]:     <video>
Oct 20 18:09:37 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:09:37 user nova-compute[74233]:     </video>
Oct 20 18:09:37 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:09:37 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:09:37 user nova-compute[74233]:     </rng>
Oct 20 18:09:37 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:09:37 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:09:37 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:09:37 user nova-compute[74233]:     </memballoon>
Oct 20 18:09:37 user nova-compute[74233]:   </devices>
Oct 20 18:09:37 user nova-compute[74233]: </domain>
Oct 20 18:09:37 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114649267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114649267',id=11,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-erxct8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:08:58Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=95824943-b9d7-4a42-ba57-56ff4aad7142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG os_vif [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b169ce90-11ee-595c-ba79-376bea93f4b2', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7731480-13, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7731480-13, col_values=(('qos', UUID('75f6af90-5a69-46ad-b066-ce2beee8c7a7')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7731480-13, col_values=(('external_ids', {'iface-id': 'e7731480-1384-4cdd-93e3-f63ae477d471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:76:a1', 'vm-uuid': '95824943-b9d7-4a42-ba57-56ff4aad7142'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:37 user nova-compute[74233]: INFO os_vif [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13')
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No VIF found with MAC fa:16:3e:7d:76:a1, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:09:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 598736896 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 880803840 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 993001472 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-334ca8c1-a007-4f58-a18b-f77aa3a24432 req-b194b97e-01fa-4cc2-afc0-d2d79c736e2b service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-334ca8c1-a007-4f58-a18b-f77aa3a24432 req-b194b97e-01fa-4cc2-afc0-d2d79c736e2b service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-334ca8c1-a007-4f58-a18b-f77aa3a24432 req-b194b97e-01fa-4cc2-afc0-d2d79c736e2b service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-334ca8c1-a007-4f58-a18b-f77aa3a24432 req-b194b97e-01fa-4cc2-afc0-d2d79c736e2b service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-334ca8c1-a007-4f58-a18b-f77aa3a24432 req-b194b97e-01fa-4cc2-afc0-d2d79c736e2b service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:39 user nova-compute[74233]: WARNING nova.compute.manager [req-334ca8c1-a007-4f58-a18b-f77aa3a24432 req-b194b97e-01fa-4cc2-afc0-d2d79c736e2b service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state building and task_state spawning.
Oct 20 18:09:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:40 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce4590a-1fa7-410e-9227-cf86d8a9c0a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:09:40 user nova-compute[74233]: No targets found.
Oct 20 18:09:40 user nova-compute[74233]: iSNS:
Oct 20 18:09:40 user nova-compute[74233]: No targets found.
Oct 20 18:09:40 user nova-compute[74233]: STATIC:
Oct 20 18:09:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36
Oct 20 18:09:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8
Oct 20 18:09:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:09:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:09:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:09:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:09:40 user nova-compute[74233]: FIRMWARE:
Oct 20 18:09:40 user nova-compute[74233]: No targets found.
Oct 20 18:09:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:09:40 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:09:40 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[510267a5-d241-4aa7-9ce1-760d6f8eb745]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d3f3f4-6a98-4d3c-ade2-24ef46fb2267]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:09:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb97052dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b8993-c82d-4262-a51c-bf646953fab0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c3546-7e6a-4899-a16d-884520c2d81a]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2925d51-9da9-423e-81f1-8a80a092612a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48167053-d1fd-4cda-a2cc-031cc2192270]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f598c-c5c5-4e83-9905-10ed64b197dd]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c221ec-2ee2-4d66-9edb-e0a9ef05da8d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]
Oct 20 18:09:40 user nova-compute[74233]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.
Oct 20 18:09:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5baab9-774b-4707-bc97-6077bd4f7e72]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] <== disconnect_volume: return (387ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whFKLdot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'da89b953-70b8-4c12-b723-8762eb3b70dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36', 'serial'} {{(pid=74233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 18:09:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] swap_volume: removing Cinder connection for volume 027a801e-8dfe-4970-89eb-77f9b334f4a6 {{(pid=74233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG nova.compute.manager [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] swap_volume: Updating volume 027a801e-8dfe-4970-89eb-77f9b334f4a6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "whFKLdot", "auth_password": "8iVvUK7ZEGD2Fh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "d03d2d5e-06e9-4602-9139-4cddd43e9a36"}, "status": "reserved", "instance": "da89b953-70b8-4c12-b723-8762eb3b70dd", "attached_at": "", "detached_at": "", "volume_id": "d03d2d5e-06e9-4602-9139-4cddd43e9a36", "serial": "d03d2d5e-06e9-4602-9139-4cddd43e9a36"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36', 'no_device': None, 'attachment_id': 'e61a6c3a-71e3-4c0a-a4ce-4b54d30b28f2'} {{(pid=74233) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-00b4b2c3-1755-4e76-b550-52bf7e8f3802 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.556s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-05a3565b-d283-40a0-9f8a-7fa122bed880 req-aba5d4b1-e1aa-494d-a346-f9a1388f4aa3 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-05a3565b-d283-40a0-9f8a-7fa122bed880 req-aba5d4b1-e1aa-494d-a346-f9a1388f4aa3 service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-05a3565b-d283-40a0-9f8a-7fa122bed880 req-aba5d4b1-e1aa-494d-a346-f9a1388f4aa3 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-05a3565b-d283-40a0-9f8a-7fa122bed880 req-aba5d4b1-e1aa-494d-a346-f9a1388f4aa3 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-05a3565b-d283-40a0-9f8a-7fa122bed880 req-aba5d4b1-e1aa-494d-a346-f9a1388f4aa3 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:09:41 user nova-compute[74233]: WARNING nova.compute.manager [req-05a3565b-d283-40a0-9f8a-7fa122bed880 req-aba5d4b1-e1aa-494d-a346-f9a1388f4aa3 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state building and task_state spawning.
Oct 20 18:09:41 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:09:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:09:41 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance spawned successfully.
Oct 20 18:09:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:09:42 user nova-compute[74233]: INFO nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 20 18:09:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:09:42 user nova-compute[74233]: INFO nova.compute.manager [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Took 45.13 seconds to build instance.
Oct 20 18:09:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-04a9d4f5-4a13-44fa-b7ee-b66f2ea1561e tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.248s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG os_brick.utils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c53a0-48a7-4350-8584-20a3fb2353e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b12a78-17bf-4b52-8dfb-c6853a87abb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce799e-2bae-4509-bcd2-e959c52e71f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0478b-6310-417a-88b5-e4fb196f5f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:43 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[074eee7e-1d73-4731-b9d9-aa7e42bee2ee]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.utils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'flavor' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:09:43 user nova-compute[74233]: INFO nova.compute.manager [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Swapping volume d03d2d5e-06e9-4602-9139-4cddd43e9a36 for 027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:43 user nova-compute[74233]: INFO nova.compute.manager [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Attaching volume db3cd346-9eb5-4d9d-8aac-a3009ce79e15 to /dev/vdb
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.utils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9427bb-0122-4783-9dea-aec332a4f902]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabd103-209b-4a8b-afeb-5b54603ee690]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d820f-11c9-46af-b6f1-13e4caf4d447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e72989a-46e5-4a77-a1cf-eb45cc40d8d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:09:43 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:09:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1367a-6cb9-4f5c-82e9-3d655cd7c436]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG os_brick.utils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:09:43 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating existing volume attachment record: e8f5dc14-864b-450e-a9cf-cb9e3e5409c1 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:09:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:51 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:51 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:51 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:09:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:09:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:09:56 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:56 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:09:56 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=25.387104034423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:09:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:09:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4597536a-b485-4bf9-938b-65471258e5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance da89b953-70b8-4c12-b723-8762eb3b70dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 51272c8a-2505-4779-bd9c-af9f352f7b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 833aa705-3460-4831-b6f4-e42e3735eee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 209fbb88-5ad9-4396-8f26-a29616f00e82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a9a937ea-ccd4-4502-b13b-09dda73e4156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:09:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:09:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hskFqLJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:02 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:02 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:02 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d91af4-09ee-4866-857f-aeba5fb9b7f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:10:02 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0824d36-2dd5-433e-afc8-cb2935ba52ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15] added
Oct 20 18:10:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6f24dc-0f3d-47a6-b5ab-c6f3902449ca]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5794c4a5-6278-41c8-874e-ff1427d877f3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hskFqLJK {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hskFqLJK" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9154e49-2d04-4ea5-bc91-ca8b98fe9dc7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hskFqLJK'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da89b953-70b8-4c12-b723-8762eb3b70dd', 'attached_at': '', 'detached_at': '', 'volume_id': '027a801e-8dfe-4970-89eb-77f9b334f4a6', 'serial': '027a801e-8dfe-4970-89eb-77f9b334f4a6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whFKLdot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36'}, 'status': 'reserved', 'instance': 'da89b953-70b8-4c12-b723-8762eb3b70dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36', 'serial'} {{(pid=74233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:02 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49a708-9676-4084-83de-87ed779a2401]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1727d71-ad7f-4bcd-9cc1-488f4c8d63c3]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4df6bf-a303-4124-b163-0fbb7061e0b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260]
Oct 20 18:10:02 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260] successful.
Oct 20 18:10:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2ff0a7-79a1-4d54-a80d-7b1cf91e2f54]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba9b6c8-6dd1-403a-8e60-46382ec96fa1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5ab089-340f-48be-8772-768c2be7f968]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:10:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hskFqLJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:10:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26539626139383833', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539626139383833', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:10:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.226s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:03 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:03 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:10:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'flavor' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08216cdb-f182-41ee-bd44-3d9a33523d08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:10:04 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:10:04 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:10:04 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:10:04 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:10:04 user nova-compute[74233]:   <serial>db3cd346-9eb5-4d9d-8aac-a3009ce79e15</serial>
Oct 20 18:10:04 user nova-compute[74233]: </disk>
Oct 20 18:10:04 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5764fa8-4fd2-4e10-8fd8-29f819a4daea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6] added
Oct 20 18:10:04 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b85bdf-21d4-433e-a504-57350b7ca716]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94408ea-864e-4ea2-996b-9434adbb9e1a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJWPCUMk {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJWPCUMk" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef23c6-9f51-46f7-867e-21d4c969ff58]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJWPCUMk'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e546bcc6-d2be-4677-936d-5ee665320fc4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26461b9-9ede-4ae0-80c7-bdfc4f511e2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae49f3-8009-4424-abe7-b16ec9a06d94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]
Oct 20 18:10:04 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.
Oct 20 18:10:04 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486254f-67e3-48e9-a0ba-11198bc15f9d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a551d0df-c491-4052-b52c-63ab647c9e8b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:04 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb76d0d-0025-4378-b6b6-5c18b4908729]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No VIF found with MAC fa:16:3e:8e:7e:86, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e3f0d264-6e1a-4ed8-bc6a-582c73b5a121 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.135s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] <== connect_volume: return (2608ms) {'type': 'block', 'scsi_wwn': '26166396337356638', 'path': '/dev/sdf'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166396337356638', 'path': '/dev/sdf'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lazy-loading 'flavor' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:05 user nova-compute[74233]: INFO nova.compute.manager [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Rescuing
Oct 20 18:10:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:10:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 131072000 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 245366784 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-54affcf0-6d25-44c1-97c3-fab546029a39 req-ce9260d4-088b-4ef5-bf53-87dd5b87d101 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-54affcf0-6d25-44c1-97c3-fab546029a39 req-ce9260d4-088b-4ef5-bf53-87dd5b87d101 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-54affcf0-6d25-44c1-97c3-fab546029a39 req-ce9260d4-088b-4ef5-bf53-87dd5b87d101 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-54affcf0-6d25-44c1-97c3-fab546029a39 req-ce9260d4-088b-4ef5-bf53-87dd5b87d101 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-54affcf0-6d25-44c1-97c3-fab546029a39 req-ce9260d4-088b-4ef5-bf53-87dd5b87d101 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:07 user nova-compute[74233]: WARNING nova.compute.manager [req-54affcf0-6d25-44c1-97c3-fab546029a39 req-ce9260d4-088b-4ef5-bf53-87dd5b87d101 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:07 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance destroyed successfully.
Oct 20 18:10:07 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Attempting a stable device rescue
Oct 20 18:10:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:10:07 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Creating image(s)
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'trusted_certs' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "aa9ca110b71d66870d63ff4e20177524008b5c7b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "aa9ca110b71d66870d63ff4e20177524008b5c7b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 602931200 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:09 user nova-compute[74233]: WARNING nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:09 user nova-compute[74233]: WARNING nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:09 user nova-compute[74233]: WARNING nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:09 user nova-compute[74233]: WARNING nova.compute.manager [req-f9469aea-0ad3-417e-8e1d-3fc034b21774 req-1902e8bd-32cb-4b77-9bfc-7d7b375fbed7 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 982515712 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.part --force-share --output=json" returned: 0 in 0.271s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG nova.virt.images [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] 7a050562-3eaa-4f43-9457-a75a6a2a142b was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.part /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.part /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.converted" returned: 0 in 0.452s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "aa9ca110b71d66870d63ff4e20177524008b5c7b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.038s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "aa9ca110b71d66870d63ff4e20177524008b5c7b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "aa9ca110b71d66870d63ff4e20177524008b5c7b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b --force-share --output=json" returned: 0 in 0.196s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b,backing_fmt=raw /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b,backing_fmt=raw /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue" returned: 0 in 0.055s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "aa9ca110b71d66870d63ff4e20177524008b5c7b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'migration_context' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Object Instance<787cb236-6ef6-4366-a564-9d85d17914f0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Start _get_guest_xml network_info=[{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "vif_mac": "fa:16:3e:8e:7e:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a050562-3eaa-4f43-9457-a75a6a2a142b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'e8f5dc14-864b-450e-a9cf-cb9e3e5409c1', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hskFqLJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '787cb236-6ef6-4366-a564-9d85d17914f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'serial': 'db3cd346-9eb5-4d9d-8aac-a3009ce79e15'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'resources' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Object Instance<787cb236-6ef6-4366-a564-9d85d17914f0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'numa_topology' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Object Instance<787cb236-6ef6-4366-a564-9d85d17914f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:11 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:10:11 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'vcpu_model' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whFKLdot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'd03d2d5e-06e9-4602-9139-4cddd43e9a36'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Object Instance<787cb236-6ef6-4366-a564-9d85d17914f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hskFqLJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a436ffe-11c8-48e2-998f-b3f49a274ede]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:10:11 user nova-compute[74233]: No targets found.
Oct 20 18:10:11 user nova-compute[74233]: iSNS:
Oct 20 18:10:11 user nova-compute[74233]: No targets found.
Oct 20 18:10:11 user nova-compute[74233]: STATIC:
Oct 20 18:10:11 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36
Oct 20 18:10:11 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:11 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:11 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8
Oct 20 18:10:11 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:11 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:11 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:10:11 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:11 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:11 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:10:11 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:11 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:11 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:10:11 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:11 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:11 user nova-compute[74233]: FIRMWARE:
Oct 20 18:10:11 user nova-compute[74233]: No targets found.
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:10:11 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:10:11 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57937bf3-481f-4fe3-937c-d8e5cac0d549]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddc2c6c-ef74-46db-a4a8-4d97b0db3fc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970608280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57016770-994d-4af0-a790-cc07deaaf7f2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e26abd-7684-4b39-ade4-d3a97b4ce686]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fb493b-0077-43f8-a2ed-26be670b4667]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c00c8-bba2-4a3d-8b07-f8060b8be2da]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[055a8032-af69-4db6-8ac6-9302c23f46fb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbcc2e0-b04c-46c9-99c2-d624e2e07d20]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260]
Oct 20 18:10:11 user nova-compute[74233]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36, portal: 172.16.0.220,3260] successful.
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-baa64d41-0d33-457d-a891-83ae52be9998 req-c13c1105-080e-4fee-b1a5-1aac58f09c13 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-baa64d41-0d33-457d-a891-83ae52be9998 req-c13c1105-080e-4fee-b1a5-1aac58f09c13 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-baa64d41-0d33-457d-a891-83ae52be9998 req-c13c1105-080e-4fee-b1a5-1aac58f09c13 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-baa64d41-0d33-457d-a891-83ae52be9998 req-c13c1105-080e-4fee-b1a5-1aac58f09c13 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-baa64d41-0d33-457d-a891-83ae52be9998 req-c13c1105-080e-4fee-b1a5-1aac58f09c13 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:11 user nova-compute[74233]: WARNING nova.compute.manager [req-baa64d41-0d33-457d-a891-83ae52be9998 req-c13c1105-080e-4fee-b1a5-1aac58f09c13 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03d2d5e-06e9-4602-9139-4cddd43e9a36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49f755-2690-4c2b-9f93-06f356fc8cf0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] <== disconnect_volume: return (366ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.340s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:11 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db567d40-dbf3-45c3-9752-744e8ce7b240]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hskFqLJK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 18:10:11 user nova-compute[74233]: node.name = iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:10:11 user nova-compute[74233]: node.tpgt = -1
Oct 20 18:10:11 user nova-compute[74233]: node.startup = automatic
Oct 20 18:10:11 user nova-compute[74233]: node.leading_login = No
Oct 20 18:10:11 user nova-compute[74233]: iface.iscsi_ifacename = default
Oct 20 18:10:11 user nova-compute[74233]: iface.net_ifacename = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.ipaddress = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.prefix_len = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.hwaddress = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.transport_name = tcp
Oct 20 18:10:11 user nova-compute[74233]: iface.initiatorname = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.vlan_id = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.vlan_priority = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.vlan_state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.iface_num = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.mtu = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.port = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.bootproto = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.subnet_mask = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.gateway = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_alt_client_id = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_dns = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_learn_iqn = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_vendor_id_state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_vendor_id = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.dhcp_slp_da = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.fragmentation = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.gratuitous_arp = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.incoming_forwarding = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.tos_state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.tos = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.ttl = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.delayed_ack = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.tcp_nagle = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.tcp_wsf_state = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.tcp_wsf = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.tcp_timer_scale = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.tcp_timestamp = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.redirect = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.def_task_mgmt_timeout = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.header_digest = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.data_digest = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.immediate_data = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.initial_r2t = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.data_seq_inorder = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.data_pdu_inorder = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.erl = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.max_receive_data_len = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.first_burst_len = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.max_outstanding_r2t = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.max_burst_len = 0
Oct 20 18:10:11 user nova-compute[74233]: iface.chap_auth = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.bidi_chap = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.strict_login_compliance = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.discovery_auth = <empty>
Oct 20 18:10:11 user nova-compute[74233]: iface.discovery_logout = <empty>
Oct 20 18:10:11 user nova-compute[74233]: node.discovery_address = <empty>
Oct 20 18:10:11 user nova-compute[74233]: node.discovery_port = 0
Oct 20 18:10:11 user nova-compute[74233]: node.discovery_type = static
Oct 20 18:10:11 user nova-compute[74233]: node.session.initial_cmdsn = 0
Oct 20 18:10:11 user nova-compute[74233]: node.session.initial_login_retry_max = 8
Oct 20 18:10:11 user nova-compute[74233]: node.session.xmit_thread_priority = -20
Oct 20 18:10:11 user nova-compute[74233]: node.session.cmds_max = 128
Oct 20 18:10:11 user nova-compute[74233]: node.session.queue_depth = 32
Oct 20 18:10:11 user nova-compute[74233]: node.session.nr_sessions = 1
Oct 20 18:10:11 user nova-compute[74233]: node.session.auth.authmethod = CHAP
Oct 20 18:10:11 user nova-compute[74233]: node.session.auth.username = hskFqLJK
Oct 20 18:10:11 user nova-compute[74233]: node.session.auth.password = ***
Oct 20 18:10:11 user nova-compute[74233]: node.session.auth.username_in = <empty>
Oct 20 18:10:11 user nova-compute[74233]: node.session.auth.password_in = <empty>
Oct 20 18:10:11 user nova-compute[74233]: node.session.auth.chap_algs = MD5
Oct 20 18:10:11 user nova-compute[74233]: node.session.timeo.replacement_timeout = 120
Oct 20 18:10:11 user nova-compute[74233]: node.session.err_timeo.abort_timeout = 15
Oct 20 18:10:11 user nova-compute[74233]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 18:10:11 user nova-compute[74233]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 18:10:11 user nova-compute[74233]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.FastAbort = Yes
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.InitialR2T = No
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.ImmediateData = Yes
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.MaxConnections = 1
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 18:10:11 user nova-compute[74233]: node.session.iscsi.ERL = 0
Oct 20 18:10:11 user nova-compute[74233]: node.session.scan = manual
Oct 20 18:10:11 user nova-compute[74233]: node.session.reopen_max = 0
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].address = 172.16.0.220
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].port = 3260
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].startup = manual
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].tcp.window_size = 524288
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].tcp.type_of_service = 0
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].timeo.logout_timeout = 15
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].timeo.login_timeout = 15
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].timeo.auth_timeout = 45
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].iscsi.DataDigest = None
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].iscsi.IFMarker = No
Oct 20 18:10:11 user nova-compute[74233]: node.conn[0].iscsi.OFMarker = No
Oct 20 18:10:11 user nova-compute[74233]: # END RECORD
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc265f8-0a20-4b6a-af10-c9d8afad2654]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6609edb0-da80-4043-953a-549a91fc43d1]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hskFqLJK {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'da89b953-70b8-4c12-b723-8762eb3b70dd', 'attached_at': '', 'detached_at': '', 'volume_id': '027a801e-8dfe-4970-89eb-77f9b334f4a6', 'serial'} {{(pid=74233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] swap_volume: removing Cinder connection for volume d03d2d5e-06e9-4602-9139-4cddd43e9a36 {{(pid=74233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hskFqLJK" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7466a732-2769-4e16-bdc8-8d2075560f2a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hskFqLJK'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0bfd69-42c8-475e-840b-0d3ecf538a8c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[271e3389-314e-424a-9fd6-9828aba21a67]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfa8d7e-d054-4a27-aacc-70e2e16ba542]: (4, ('0 0 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hskFqLJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] <== connect_volume: return (521ms) {'type': 'block', 'scsi_wwn': '26539626139383833', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539626139383833', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1799510366',display_name='tempest-ServerStableDeviceRescueTest-server-1799510366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1799510366',id=4,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWAzatv9vgWsTaQRaMw733k1HcQFUPs/2CdZmpTrrnaVx5jCahzct2xVjsdAoOw923F+CvNnKuXVCic8N+GGORLyN22CLzYBi6Iqg7X9YSJ6YDZTQhz9DsFEfeoo9ysAg==',key_name='tempest-keypair-1389511728',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4438cc27f48243beacf618702f82de4b',ramdisk_id='',reservation_id='r-df0slk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2000827243',owner_user_name='tempest-ServerStableDeviceRescueTest-2000827243-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5880cc8b27b4906a89d92f4fc4c2d05',uuid=787cb236-6ef6-4366-a564-9d85d17914f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "vif_mac": "fa:16:3e:8e:7e:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converting VIF {"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "vif_mac": "fa:16:3e:8e:7e:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'pci_devices' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.objects.base [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Object Instance<787cb236-6ef6-4366-a564-9d85d17914f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:10:11 user nova-compute[74233]:   <uuid>787cb236-6ef6-4366-a564-9d85d17914f0</uuid>
Oct 20 18:10:11 user nova-compute[74233]:   <name>instance-00000004</name>
Oct 20 18:10:11 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:10:11 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:10:11 user nova-compute[74233]:   <metadata>
Oct 20 18:10:11 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:10:11 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:10:11 user nova-compute[74233]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1799510366</nova:name>
Oct 20 18:10:11 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:10:11</nova:creationTime>
Oct 20 18:10:11 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:10:11 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:10:11 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:10:11 user nova-compute[74233]:       <nova:owner>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:user uuid="a5880cc8b27b4906a89d92f4fc4c2d05">tempest-ServerStableDeviceRescueTest-2000827243-project-member</nova:user>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:project uuid="4438cc27f48243beacf618702f82de4b">tempest-ServerStableDeviceRescueTest-2000827243</nova:project>
Oct 20 18:10:11 user nova-compute[74233]:       </nova:owner>
Oct 20 18:10:11 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:10:11 user nova-compute[74233]:       <nova:ports>
Oct 20 18:10:11 user nova-compute[74233]:         <nova:port uuid="7371e3fd-09e0-43d8-8468-61178a7cffc4">
Oct 20 18:10:11 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:10:11 user nova-compute[74233]:         </nova:port>
Oct 20 18:10:11 user nova-compute[74233]:       </nova:ports>
Oct 20 18:10:11 user nova-compute[74233]:     </nova:instance>
Oct 20 18:10:11 user nova-compute[74233]:   </metadata>
Oct 20 18:10:11 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:10:11 user nova-compute[74233]:     <system>
Oct 20 18:10:11 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:10:11 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:10:11 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:10:11 user nova-compute[74233]:       <entry name="serial">787cb236-6ef6-4366-a564-9d85d17914f0</entry>
Oct 20 18:10:11 user nova-compute[74233]:       <entry name="uuid">787cb236-6ef6-4366-a564-9d85d17914f0</entry>
Oct 20 18:10:11 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:10:11 user nova-compute[74233]:     </system>
Oct 20 18:10:11 user nova-compute[74233]:   </sysinfo>
Oct 20 18:10:11 user nova-compute[74233]:   <os>
Oct 20 18:10:11 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:10:11 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:10:11 user nova-compute[74233]:   </os>
Oct 20 18:10:11 user nova-compute[74233]:   <features>
Oct 20 18:10:11 user nova-compute[74233]:     <acpi/>
Oct 20 18:10:11 user nova-compute[74233]:     <apic/>
Oct 20 18:10:11 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:10:11 user nova-compute[74233]:   </features>
Oct 20 18:10:11 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:10:11 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:10:11 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:10:11 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:10:11 user nova-compute[74233]:   </clock>
Oct 20 18:10:11 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:10:11 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:10:11 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:10:11 user nova-compute[74233]:   </cpu>
Oct 20 18:10:11 user nova-compute[74233]:   <devices>
Oct 20 18:10:11 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:10:11 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:10:11 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk"/>
Oct 20 18:10:11 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:10:11 user nova-compute[74233]:     </disk>
Oct 20 18:10:11 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:10:11 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:10:11 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:10:11 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:10:11 user nova-compute[74233]:       <serial>db3cd346-9eb5-4d9d-8aac-a3009ce79e15</serial>
Oct 20 18:10:11 user nova-compute[74233]:     </disk>
Oct 20 18:10:11 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:10:11 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:10:11 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue"/>
Oct 20 18:10:11 user nova-compute[74233]:       <target dev="vdc" bus="virtio"/>
Oct 20 18:10:11 user nova-compute[74233]:       <boot order="1"/>
Oct 20 18:10:11 user nova-compute[74233]:     </disk>
Oct 20 18:10:11 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:10:11 user nova-compute[74233]:       <mac address="fa:16:3e:8e:7e:86"/>
Oct 20 18:10:11 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:10:11 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:10:11 user nova-compute[74233]:       <target dev="tap7371e3fd-09"/>
Oct 20 18:10:11 user nova-compute[74233]:     </interface>
Oct 20 18:10:11 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:10:11 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/console.log" append="off"/>
Oct 20 18:10:11 user nova-compute[74233]:     </serial>
Oct 20 18:10:11 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:10:11 user nova-compute[74233]:     <video>
Oct 20 18:10:11 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:10:11 user nova-compute[74233]:     </video>
Oct 20 18:10:11 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:10:11 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:10:11 user nova-compute[74233]:     </rng>
Oct 20 18:10:11 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:10:11 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:10:11 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:10:11 user nova-compute[74233]:     </memballoon>
Oct 20 18:10:11 user nova-compute[74233]:   </devices>
Oct 20 18:10:11 user nova-compute[74233]: </domain>
Oct 20 18:10:11 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:10:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance destroyed successfully.
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] No VIF found with MAC fa:16:3e:8e:7e:86, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:10:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-1def4dcc-8d4a-4c06-8afa-dd83e95b1b08 req-90021c7c-290e-43ed-8de7-3091f7a36b6a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1def4dcc-8d4a-4c06-8afa-dd83e95b1b08 req-90021c7c-290e-43ed-8de7-3091f7a36b6a service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1def4dcc-8d4a-4c06-8afa-dd83e95b1b08 req-90021c7c-290e-43ed-8de7-3091f7a36b6a service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1def4dcc-8d4a-4c06-8afa-dd83e95b1b08 req-90021c7c-290e-43ed-8de7-3091f7a36b6a service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-1def4dcc-8d4a-4c06-8afa-dd83e95b1b08 req-90021c7c-290e-43ed-8de7-3091f7a36b6a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:13 user nova-compute[74233]: WARNING nova.compute.manager [req-1def4dcc-8d4a-4c06-8afa-dd83e95b1b08 req-90021c7c-290e-43ed-8de7-3091f7a36b6a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:13 user nova-compute[74233]: INFO nova.compute.manager [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Terminating instance
Oct 20 18:10:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-7341a95f-df4a-4c1a-b0ee-dd5102f11d5b req-1fd1a9b8-631f-4089-ba8f-300c7e063ac4 service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-vif-unplugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7341a95f-df4a-4c1a-b0ee-dd5102f11d5b req-1fd1a9b8-631f-4089-ba8f-300c7e063ac4 service nova] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7341a95f-df4a-4c1a-b0ee-dd5102f11d5b req-1fd1a9b8-631f-4089-ba8f-300c7e063ac4 service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7341a95f-df4a-4c1a-b0ee-dd5102f11d5b req-1fd1a9b8-631f-4089-ba8f-300c7e063ac4 service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-7341a95f-df4a-4c1a-b0ee-dd5102f11d5b req-1fd1a9b8-631f-4089-ba8f-300c7e063ac4 service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] No waiting events found dispatching network-vif-unplugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-7341a95f-df4a-4c1a-b0ee-dd5102f11d5b req-1fd1a9b8-631f-4089-ba8f-300c7e063ac4 service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-vif-unplugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:10:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Instance destroyed successfully.
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lazy-loading 'resources' on Instance uuid 51272c8a-2505-4779-bd9c-af9f352f7b7b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1613662639',display_name='tempest-VolumesAssistedSnapshotsTest-server-1613662639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1613662639',id=8,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr/k8jYEuhBJRNqSvdUJhtLpo6SHZNEr7FyvX44UHZVsBe0Gnswa/Y7jGp79J0H4B7BY/ZqIFAOTQ1rb9Pg6Zf5JYuk+qyKsYloAbTSIoBYTKYHbesbV/mgl5Tu1Qwthg==',key_name='tempest-keypair-1173838449',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db657bd6ae54226814be3f4abfeeebb',ramdisk_id='',reservation_id='r-ikd0pua1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1600140476',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1600140476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a1ef5af49f549df9b09640493a9745a',uuid=51272c8a-2505-4779-bd9c-af9f352f7b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Converting VIF {"id": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "address": "fa:16:3e:73:67:56", "network": {"id": "bf177f2d-5caa-4285-b30f-02ea74d80682", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-334854459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db657bd6ae54226814be3f4abfeeebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee394bd-2e", "ovs_interfaceid": "1ee394bd-2e7e-4d9c-b032-235c936fe93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG os_vif [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ee394bd-2e, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ae5b558-a7ee-45fe-b2ac-a463de9172ac) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: INFO os_vif [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:67:56,bridge_name='br-int',has_traffic_filtering=True,id=1ee394bd-2e7e-4d9c-b032-235c936fe93b,network=Network(bf177f2d-5caa-4285-b30f-02ea74d80682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee394bd-2e')
Oct 20 18:10:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Deleting instance files /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b_del
Oct 20 18:10:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Deletion of /opt/stack/data/nova/instances/51272c8a-2505-4779-bd9c-af9f352f7b7b_del complete
Oct 20 18:10:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:14 user nova-compute[74233]: INFO nova.compute.manager [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 18:10:14 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:10:14 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:15 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Took 0.76 seconds to deallocate network for instance.
Oct 20 18:10:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4d31541e-d0c6-427c-9ca3-a178eeca356a tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:15 user nova-compute[74233]: WARNING nova.compute.manager [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-9520f735-cb5f-4e34-8346-480cd0f0261b req-13cef1d0-2dbe-404d-838b-e4edc8c13dbf service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-vif-deleted-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:16 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Deleted allocations for instance 51272c8a-2505-4779-bd9c-af9f352f7b7b
Oct 20 18:10:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b27a3781-1529-4bb6-b5ee-9787a1ce6c0d tempest-VolumesAssistedSnapshotsTest-1600140476 tempest-VolumesAssistedSnapshotsTest-1600140476-project-member] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.301s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-37b4bb08-efb2-4864-a4e1-b20feaeabe4d req-598a037b-7683-4d8d-a1d6-4a95b528a06b service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received event network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-37b4bb08-efb2-4864-a4e1-b20feaeabe4d req-598a037b-7683-4d8d-a1d6-4a95b528a06b service nova] Acquiring lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-37b4bb08-efb2-4864-a4e1-b20feaeabe4d req-598a037b-7683-4d8d-a1d6-4a95b528a06b service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-37b4bb08-efb2-4864-a4e1-b20feaeabe4d req-598a037b-7683-4d8d-a1d6-4a95b528a06b service nova] Lock "51272c8a-2505-4779-bd9c-af9f352f7b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-37b4bb08-efb2-4864-a4e1-b20feaeabe4d req-598a037b-7683-4d8d-a1d6-4a95b528a06b service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] No waiting events found dispatching network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:16 user nova-compute[74233]: WARNING nova.compute.manager [req-37b4bb08-efb2-4864-a4e1-b20feaeabe4d req-598a037b-7683-4d8d-a1d6-4a95b528a06b service nova] [instance: 51272c8a-2505-4779-bd9c-af9f352f7b7b] Received unexpected event network-vif-plugged-1ee394bd-2e7e-4d9c-b032-235c936fe93b for instance with vm_state deleted and task_state None.
Oct 20 18:10:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] swap_volume: Updating volume d03d2d5e-06e9-4602-9139-4cddd43e9a36 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "VJWPCUMk", "auth_password": "4hNoi29awWUpOZ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "027a801e-8dfe-4970-89eb-77f9b334f4a6"}, "status": "reserved", "instance": "da89b953-70b8-4c12-b723-8762eb3b70dd", "attached_at": "", "detached_at": "", "volume_id": "027a801e-8dfe-4970-89eb-77f9b334f4a6", "serial": "027a801e-8dfe-4970-89eb-77f9b334f4a6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '027a801e-8dfe-4970-89eb-77f9b334f4a6', 'no_device': None, 'attachment_id': '9b9a5f38-af20-460a-a96e-ab4aa386b3cd'} {{(pid=74233) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 18:10:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7dd31af1-b33e-48c8-848b-fc5450cf2242 tempest-TestVolumeSwap-1190798866 tempest-TestVolumeSwap-1190798866-project-admin] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 34.268s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:18 user nova-compute[74233]: INFO nova.compute.manager [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Detaching volume 027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:10:18 user nova-compute[74233]: INFO nova.virt.block_device [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Attempting to driver detach volume 027a801e-8dfe-4970-89eb-77f9b334f4a6 from mountpoint /dev/vdb
Oct 20 18:10:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Attempting to detach device vdb from instance da89b953-70b8-4c12-b723-8762eb3b70dd from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:10:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:10:18 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:10:18 user nova-compute[74233]:   <source dev="/dev/sdf"/>
Oct 20 18:10:18 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:10:18 user nova-compute[74233]:   <serial>027a801e-8dfe-4970-89eb-77f9b334f4a6</serial>
Oct 20 18:10:18 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:10:18 user nova-compute[74233]: </disk>
Oct 20 18:10:18 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:10:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Successfully detached device vdb from instance da89b953-70b8-4c12-b723-8762eb3b70dd from the persistent domain config.
Oct 20 18:10:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da89b953-70b8-4c12-b723-8762eb3b70dd from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:10:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:10:18 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:10:18 user nova-compute[74233]:   <source dev="/dev/sdf"/>
Oct 20 18:10:18 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:10:18 user nova-compute[74233]:   <serial>027a801e-8dfe-4970-89eb-77f9b334f4a6</serial>
Oct 20 18:10:18 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:10:18 user nova-compute[74233]: </disk>
Oct 20 18:10:18 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:10:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:10:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-changed-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Refreshing instance network info cache due to event network-changed-8b1cba4f-5c21-4ca1-acd3-865fb68f060a. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:10:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] Acquiring lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:10:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] Acquired lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:10:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Refreshing network info cache for port 8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'flavor' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:28 user nova-compute[74233]: INFO nova.compute.manager [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attaching volume bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec to /dev/vdb
Oct 20 18:10:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updated VIF entry in instance network info cache for port 8b1cba4f-5c21-4ca1-acd3-865fb68f060a. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updating instance_info_cache with network_info: [{"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c4ad9ef8-1d07-43e7-a168-0094bfb8fa43 req-537c861c-9a72-45c1-82d1-c0146ef383ff service nova] Releasing lock "refresh_cache-833aa705-3460-4831-b6f4-e42e3735eee3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG os_brick.utils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:28 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1733a92-60b8-4038-bf64-3f4f8d76b415]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2190f1-b789-43a3-8363-b7268098259e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20014ad0-e02d-4248-8a8e-2b92eefe8dab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12213fc0-6c19-4ce5-b6f1-84ca2ca1f269]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:10:29 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:10:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f677b0-d58f-494c-a94b-1b2848e73877]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG os_brick.utils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updating existing volume attachment record: 002d0bef-2d6c-4e89-ba4d-a81bb99072d2 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:33 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:10:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:33 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:10:33 user nova-compute[74233]: INFO nova.compute.claims [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Claim successful on node user
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:10:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.policy [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02bbe839e32f41268676839457c3abbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d20ec6bba044fb8aff5094ac65ac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:10:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Creating image(s)
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "/opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "/opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "/opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.227s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.221s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk 1073741824" returned: 0 in 0.068s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Successfully created port: 13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Cannot resize image /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Ensure instance console log exists: /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Successfully updated port: 13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquired lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-changed-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Refreshing instance network info cache due to event network-changed-13d90459-841f-4f52-a89d-372094d65561. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] Acquiring lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Updating instance_info_cache with network_info: [{"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Releasing lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Instance network_info: |[{"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] Acquired lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.neutron [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Refreshing network info cache for port 13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Start _get_guest_xml network_info=[{"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:10:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:10:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-979855548',display_name='tempest-ServersNegativeTestJSON-server-979855548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-979855548',id=13,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d20ec6bba044fb8aff5094ac65ac52',ramdisk_id='',reservation_id='r-m0ui66aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-627903216',owner_user_name='tempest-ServersNegativeTestJSON-627903216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:10:34Z,user_data=None,user_id='02bbe839e32f41268676839457c3abbd',uuid=c309386c-5cca-46e0-96b9-754e82d47e3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converting VIF {"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lazy-loading 'pci_devices' on Instance uuid c309386c-5cca-46e0-96b9-754e82d47e3e {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:10:36 user nova-compute[74233]:   <uuid>c309386c-5cca-46e0-96b9-754e82d47e3e</uuid>
Oct 20 18:10:36 user nova-compute[74233]:   <name>instance-0000000d</name>
Oct 20 18:10:36 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:10:36 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:10:36 user nova-compute[74233]:   <metadata>
Oct 20 18:10:36 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:10:36 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:10:36 user nova-compute[74233]:       <nova:name>tempest-ServersNegativeTestJSON-server-979855548</nova:name>
Oct 20 18:10:36 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:10:36</nova:creationTime>
Oct 20 18:10:36 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:10:36 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:10:36 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:10:36 user nova-compute[74233]:       <nova:owner>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:user uuid="02bbe839e32f41268676839457c3abbd">tempest-ServersNegativeTestJSON-627903216-project-member</nova:user>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:project uuid="75d20ec6bba044fb8aff5094ac65ac52">tempest-ServersNegativeTestJSON-627903216</nova:project>
Oct 20 18:10:36 user nova-compute[74233]:       </nova:owner>
Oct 20 18:10:36 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:10:36 user nova-compute[74233]:       <nova:ports>
Oct 20 18:10:36 user nova-compute[74233]:         <nova:port uuid="13d90459-841f-4f52-a89d-372094d65561">
Oct 20 18:10:36 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:10:36 user nova-compute[74233]:         </nova:port>
Oct 20 18:10:36 user nova-compute[74233]:       </nova:ports>
Oct 20 18:10:36 user nova-compute[74233]:     </nova:instance>
Oct 20 18:10:36 user nova-compute[74233]:   </metadata>
Oct 20 18:10:36 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:10:36 user nova-compute[74233]:     <system>
Oct 20 18:10:36 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:10:36 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:10:36 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:10:36 user nova-compute[74233]:       <entry name="serial">c309386c-5cca-46e0-96b9-754e82d47e3e</entry>
Oct 20 18:10:36 user nova-compute[74233]:       <entry name="uuid">c309386c-5cca-46e0-96b9-754e82d47e3e</entry>
Oct 20 18:10:36 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:10:36 user nova-compute[74233]:     </system>
Oct 20 18:10:36 user nova-compute[74233]:   </sysinfo>
Oct 20 18:10:36 user nova-compute[74233]:   <os>
Oct 20 18:10:36 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:10:36 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:10:36 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:10:36 user nova-compute[74233]:   </os>
Oct 20 18:10:36 user nova-compute[74233]:   <features>
Oct 20 18:10:36 user nova-compute[74233]:     <acpi/>
Oct 20 18:10:36 user nova-compute[74233]:     <apic/>
Oct 20 18:10:36 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:10:36 user nova-compute[74233]:   </features>
Oct 20 18:10:36 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:10:36 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:10:36 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:10:36 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:10:36 user nova-compute[74233]:   </clock>
Oct 20 18:10:36 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:10:36 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:10:36 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:10:36 user nova-compute[74233]:   </cpu>
Oct 20 18:10:36 user nova-compute[74233]:   <devices>
Oct 20 18:10:36 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:10:36 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:10:36 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk"/>
Oct 20 18:10:36 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:10:36 user nova-compute[74233]:     </disk>
Oct 20 18:10:36 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:10:36 user nova-compute[74233]:       <mac address="fa:16:3e:b8:0f:e8"/>
Oct 20 18:10:36 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:10:36 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:10:36 user nova-compute[74233]:       <target dev="tap13d90459-84"/>
Oct 20 18:10:36 user nova-compute[74233]:     </interface>
Oct 20 18:10:36 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:10:36 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/console.log" append="off"/>
Oct 20 18:10:36 user nova-compute[74233]:     </serial>
Oct 20 18:10:36 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:10:36 user nova-compute[74233]:     <video>
Oct 20 18:10:36 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:10:36 user nova-compute[74233]:     </video>
Oct 20 18:10:36 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:10:36 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:10:36 user nova-compute[74233]:     </rng>
Oct 20 18:10:36 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:10:36 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:10:36 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:10:36 user nova-compute[74233]:     </memballoon>
Oct 20 18:10:36 user nova-compute[74233]:   </devices>
Oct 20 18:10:36 user nova-compute[74233]: </domain>
Oct 20 18:10:36 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-979855548',display_name='tempest-ServersNegativeTestJSON-server-979855548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-979855548',id=13,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d20ec6bba044fb8aff5094ac65ac52',ramdisk_id='',reservation_id='r-m0ui66aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-627903216',owner_user_name='tempest-ServersNegativeTestJSON-627903216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:10:34Z,user_data=None,user_id='02bbe839e32f41268676839457c3abbd',uuid=c309386c-5cca-46e0-96b9-754e82d47e3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converting VIF {"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG os_vif [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4285073d-a91f-5fd6-bbbe-a9fed8a1ed59', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13d90459-84, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13d90459-84, col_values=(('qos', UUID('a59ce6e1-5759-47e3-90d8-a7aa87d28304')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13d90459-84, col_values=(('external_ids', {'iface-id': '13d90459-841f-4f52-a89d-372094d65561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:0f:e8', 'vm-uuid': 'c309386c-5cca-46e0-96b9-754e82d47e3e'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:36 user nova-compute[74233]: INFO os_vif [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84')
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] No VIF found with MAC fa:16:3e:b8:0f:e8, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:37 user nova-compute[74233]: INFO nova.compute.manager [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Terminating instance
Oct 20 18:10:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Updated VIF entry in instance network info cache for port 13d90459-841f-4f52-a89d-372094d65561. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Updating instance_info_cache with network_info: [{"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9b9b5f6-62e8-40d3-b637-5894d7adb921 req-81288321-7a85-45bf-8cf1-5c6a5de79b80 service nova] Releasing lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-4e86e639-e6cb-47d9-a5d9-caceba41e6ad req-8c020d9c-7a62-4ba3-80e3-866b7d013f6d service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-vif-unplugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4e86e639-e6cb-47d9-a5d9-caceba41e6ad req-8c020d9c-7a62-4ba3-80e3-866b7d013f6d service nova] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4e86e639-e6cb-47d9-a5d9-caceba41e6ad req-8c020d9c-7a62-4ba3-80e3-866b7d013f6d service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4e86e639-e6cb-47d9-a5d9-caceba41e6ad req-8c020d9c-7a62-4ba3-80e3-866b7d013f6d service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-4e86e639-e6cb-47d9-a5d9-caceba41e6ad req-8c020d9c-7a62-4ba3-80e3-866b7d013f6d service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] No waiting events found dispatching network-vif-unplugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-4e86e639-e6cb-47d9-a5d9-caceba41e6ad req-8c020d9c-7a62-4ba3-80e3-866b7d013f6d service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-vif-unplugged-e52539c7-5115-4326-afe9-649918d5bd82 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:10:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Instance destroyed successfully.
Oct 20 18:10:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'resources' on Instance uuid 209fbb88-5ad9-4396-8f26-a29616f00e82 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1858684839',display_name='tempest-TestVolumeBootPattern-server-1858684839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1858684839',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-ggfa0clj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:09:18Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=209fbb88-5ad9-4396-8f26-a29616f00e82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "e52539c7-5115-4326-afe9-649918d5bd82", "address": "fa:16:3e:b5:f9:1b", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape52539c7-51", "ovs_interfaceid": "e52539c7-5115-4326-afe9-649918d5bd82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_vif [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape52539c7-51, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db993578-6f88-49af-ba1a-7ab87cb1947f) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: INFO os_vif [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=e52539c7-5115-4326-afe9-649918d5bd82,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape52539c7-51')
Oct 20 18:10:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqfaMpRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:38 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c2a456-f7aa-47e6-abd9-f3e7bbe8b80b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:10:38 user nova-compute[74233]: No targets found.
Oct 20 18:10:38 user nova-compute[74233]: iSNS:
Oct 20 18:10:38 user nova-compute[74233]: No targets found.
Oct 20 18:10:38 user nova-compute[74233]: STATIC:
Oct 20 18:10:38 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8
Oct 20 18:10:38 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:38 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:38 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:10:38 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:38 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:38 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:10:38 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:38 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:38 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:10:38 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:38 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:38 user nova-compute[74233]: FIRMWARE:
Oct 20 18:10:38 user nova-compute[74233]: No targets found.
Oct 20 18:10:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:10:38 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:10:38 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251de44-b3b4-402e-9c2b-cf8ae36162af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3859c0bc-8e3f-4c38-b147-0d749a4657c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9705ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdb2ba8-1227-49c6-b3bf-f597374033f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e2c5b-c89a-45ca-bf2f-6c0a2eabbb3d]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0586473f-c536-425c-a343-f15a2f60ccb6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac1050-8521-47a5-9cd5-4c4392495592]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff0a1a0-ff94-472d-b8aa-a3376d32ea75]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[352557dd-aaa7-4b89-8bc4-3ccede351bf4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260]
Oct 20 18:10:38 user nova-compute[74233]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8, portal: 172.16.0.220,3260] successful.
Oct 20 18:10:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45caf46c-e730-4573-8ded-2636ce5aa1b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa95ae1-b977-4d91-aeb0-a84de2cb6a62]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== disconnect_volume: return (363ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:10:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Deleting instance files /opt/stack/data/nova/instances/209fbb88-5ad9-4396-8f26-a29616f00e82_del
Oct 20 18:10:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Deletion of /opt/stack/data/nova/instances/209fbb88-5ad9-4396-8f26-a29616f00e82_del complete
Oct 20 18:10:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:39 user nova-compute[74233]: INFO nova.compute.manager [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Took 2.06 seconds to destroy the instance on the hypervisor.
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:10:39 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da89b953-70b8-4c12-b723-8762eb3b70dd is timed out.
Oct 20 18:10:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Successfully detached device vdb from instance da89b953-70b8-4c12-b723-8762eb3b70dd from the live domain config.
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJWPCUMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '027a801e-8dfe-4970-89eb-77f9b334f4a6'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:39 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c26277-499c-4c03-b8ff-5daae91a4c8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:10:39 user nova-compute[74233]: No targets found.
Oct 20 18:10:39 user nova-compute[74233]: iSNS:
Oct 20 18:10:39 user nova-compute[74233]: No targets found.
Oct 20 18:10:39 user nova-compute[74233]: STATIC:
Oct 20 18:10:39 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:10:39 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:39 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:39 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:10:39 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:39 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:39 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6
Oct 20 18:10:39 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:10:39 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:10:39 user nova-compute[74233]: FIRMWARE:
Oct 20 18:10:39 user nova-compute[74233]: No targets found.
Oct 20 18:10:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:10:39 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:10:39 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c77bc-53ac-4578-8eac-f5272c2809ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be0835-ca59-4ee7-8c2c-ff66c9e7040c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:39 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:39 user nova-compute[74233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 (non-flash)
Oct 20 18:10:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9705c9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6'): ({'sdf'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Removing single pathed devices sdf {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175fcdf-71c7-4680-be53-f753871b0879]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3399258-8677-4525-a1c1-674a33208bf2]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Flushing IO for device /dev/sdf {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8702dd-03d5-4847-be80-9888b248998e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13043bf-6e98-42dc-8d72-fbfc4132213a]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Acquiring lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] No waiting events found dispatching network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:39 user nova-compute[74233]: WARNING nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received unexpected event network-vif-plugged-e52539c7-5115-4326-afe9-649918d5bd82 for instance with vm_state active and task_state deleting.
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] No waiting events found dispatching network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:39 user nova-compute[74233]: WARNING nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received unexpected event network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 for instance with vm_state building and task_state spawning.
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] No waiting events found dispatching network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:39 user nova-compute[74233]: WARNING nova.compute.manager [req-3d52eb6e-9004-4687-833f-978a796bd010 req-b96953b0-624b-4fb5-a97c-8f9bae2a220d service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received unexpected event network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 for instance with vm_state building and task_state spawning.
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e893f5e-0082-4d7e-aefd-dbe79a8ed0c5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edfb255-a66b-4ad2-88d9-21cacbc292c3]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260]
Oct 20 18:10:39 user nova-compute[74233]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6, portal: 172.16.0.220,3260] successful.
Oct 20 18:10:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:39 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Took 0.58 seconds to deallocate network for instance.
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-bb2fba6c-0ed0-45b0-b4e7-15b36ded6993 req-7d8e914b-2e7d-414a-8d99-7a244112bde4 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Received event network-vif-deleted-e52539c7-5115-4326-afe9-649918d5bd82 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:39 user nova-compute[74233]: INFO nova.compute.manager [req-bb2fba6c-0ed0-45b0-b4e7-15b36ded6993 req-7d8e914b-2e7d-414a-8d99-7a244112bde4 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Neutron deleted interface e52539c7-5115-4326-afe9-649918d5bd82; detaching it from the instance and deleting it from the info cache
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-bb2fba6c-0ed0-45b0-b4e7-15b36ded6993 req-7d8e914b-2e7d-414a-8d99-7a244112bde4 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:027a801e-8dfe-4970-89eb-77f9b334f4a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0540bc2-8022-4eac-a094-df8dd138aafa]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] <== disconnect_volume: return (360ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-bb2fba6c-0ed0-45b0-b4e7-15b36ded6993 req-7d8e914b-2e7d-414a-8d99-7a244112bde4 service nova] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Detach interface failed, port_id=e52539c7-5115-4326-afe9-649918d5bd82, reason: Instance 209fbb88-5ad9-4396-8f26-a29616f00e82 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:40 user nova-compute[74233]: DEBUG nova.objects.instance [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lazy-loading 'flavor' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:40 user nova-compute[74233]: INFO nova.compute.manager [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Took 0.93 seconds to detach 1 volumes for instance.
Oct 20 18:10:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 209fbb88-5ad9-4396-8f26-a29616f00e82] Deleting volume: 45caf46c-e730-4573-8ded-2636ce5aa1b8 {{(pid=74233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 18:10:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fedb5360-87f8-4670-9422-ef929b57d8d6 tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.955s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:10:41 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Instance spawned successfully.
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:10:41 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Deleted allocations for instance 209fbb88-5ad9-4396-8f26-a29616f00e82
Oct 20 18:10:41 user nova-compute[74233]: INFO nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Took 6.81 seconds to spawn the instance on the hypervisor.
Oct 20 18:10:41 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:10:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-81085e5a-02b0-41ab-8207-cce8f3d0f3e4 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "209fbb88-5ad9-4396-8f26-a29616f00e82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.253s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:41 user nova-compute[74233]: INFO nova.compute.manager [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Took 7.64 seconds to build instance.
Oct 20 18:10:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9c1b375d-3eaa-4403-a15b-14a9bc373a33 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.759s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:48 user nova-compute[74233]: INFO nova.compute.manager [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Rescuing
Oct 20 18:10:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:10:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:10:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:10:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJPEVIKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:49 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:49 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:49 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b231c1-dd68-412c-add8-8470105a5306]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:10:49 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e24f5-20f9-4b79-b306-323fa3c0886d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec] added
Oct 20 18:10:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9af6ae-21e4-4475-b42b-3a1789541c0b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cfb271-457d-4c92-8ff8-4e5dc5dc55cf]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJPEVIKo {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJPEVIKo" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[34142ad1-e533-4bdc-8653-8e787486bf1e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJPEVIKo'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598b1e3-3843-4324-b966-392add4eee96]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c72c43b-5bda-480a-9fe7-315391606117]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-08c73c9c-67b6-490c-bf75-2f166ddb2fa6 req-e572783f-f7c7-4c9d-8ef6-c0d072c59e8e service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08c73c9c-67b6-490c-bf75-2f166ddb2fa6 req-e572783f-f7c7-4c9d-8ef6-c0d072c59e8e service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08c73c9c-67b6-490c-bf75-2f166ddb2fa6 req-e572783f-f7c7-4c9d-8ef6-c0d072c59e8e service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08c73c9c-67b6-490c-bf75-2f166ddb2fa6 req-e572783f-f7c7-4c9d-8ef6-c0d072c59e8e service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-08c73c9c-67b6-490c-bf75-2f166ddb2fa6 req-e572783f-f7c7-4c9d-8ef6-c0d072c59e8e service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:49 user nova-compute[74233]: WARNING nova.compute.manager [req-08c73c9c-67b6-490c-bf75-2f166ddb2fa6 req-e572783f-f7c7-4c9d-8ef6-c0d072c59e8e service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2a777-6e0f-4af9-97d2-6619aea23833]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260]
Oct 20 18:10:49 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260] successful.
Oct 20 18:10:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e7f23c-cd6e-49b7-9fe2-3a4da71e4cf0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe1e82b-2a72-461e-ac62-256491bb29af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:10:49 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:10:49 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74cc3dc-6d99-43c3-a2ec-e5897103d95b]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJPEVIKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:49 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance destroyed successfully.
Oct 20 18:10:49 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Attempting a stable device rescue
Oct 20 18:10:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:10:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Creating image(s)
Oct 20 18:10:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "/opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.802s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] <== connect_volume: return (1806ms) {'type': 'block', 'scsi_wwn': '23736663832306663', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736663832306663', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'flavor' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:10:50 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:10:50 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:10:50 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:10:50 user nova-compute[74233]:   <serial>bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec</serial>
Oct 20 18:10:50 user nova-compute[74233]: </disk>
Oct 20 18:10:50 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.part --force-share --output=json" returned: 0 in 0.212s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.images [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] b82602e0-5b4a-47f6-a35f-58d0f7a08318 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.part /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.part /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.converted" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-974f16e5-8d79-4f34-b995-21f36f026370 req-1429cb0c-ae3b-4068-a65b-a632304f8a9b service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-974f16e5-8d79-4f34-b995-21f36f026370 req-1429cb0c-ae3b-4068-a65b-a632304f8a9b service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-974f16e5-8d79-4f34-b995-21f36f026370 req-1429cb0c-ae3b-4068-a65b-a632304f8a9b service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-974f16e5-8d79-4f34-b995-21f36f026370 req-1429cb0c-ae3b-4068-a65b-a632304f8a9b service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-974f16e5-8d79-4f34-b995-21f36f026370 req-1429cb0c-ae3b-4068-a65b-a632304f8a9b service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:51 user nova-compute[74233]: WARNING nova.compute.manager [req-974f16e5-8d79-4f34-b995-21f36f026370 req-1429cb0c-ae3b-4068-a65b-a632304f8a9b service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No VIF found with MAC fa:16:3e:6d:6d:46, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae,backing_fmt=raw /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d40182ed-a0b3-4a33-87aa-e4f91940f529 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.416s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae,backing_fmt=raw /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue" returned: 0 in 0.065s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'migration_context' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<95824943-b9d7-4a42-ba57-56ff4aad7142> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Start _get_guest_xml network_info=[{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "vif_mac": "fa:16:3e:7d:76:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b82602e0-5b4a-47f6-a35f-58d0f7a08318', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '7b26a147-538e-4bc2-9458-ebde369e6eca', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '95824943-b9d7-4a42-ba57-56ff4aad7142', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7995a08-6018-45ef-89cd-d30bcfb34fb3', 'serial': 'd7995a08-6018-45ef-89cd-d30bcfb34fb3'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'resources' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<95824943-b9d7-4a42-ba57-56ff4aad7142> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'numa_topology' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<95824943-b9d7-4a42-ba57-56ff4aad7142> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:51 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:10:51 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.objects.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<95824943-b9d7-4a42-ba57-56ff4aad7142> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:51 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:51 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:10:51 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f03bef-3b2a-480a-bc82-6ac12e741c5c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = bjDxINpY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 18:10:51 user nova-compute[74233]: node.name = iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:10:51 user nova-compute[74233]: node.tpgt = -1
Oct 20 18:10:51 user nova-compute[74233]: node.startup = automatic
Oct 20 18:10:51 user nova-compute[74233]: node.leading_login = No
Oct 20 18:10:51 user nova-compute[74233]: iface.iscsi_ifacename = default
Oct 20 18:10:51 user nova-compute[74233]: iface.net_ifacename = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.ipaddress = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.prefix_len = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.hwaddress = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.transport_name = tcp
Oct 20 18:10:51 user nova-compute[74233]: iface.initiatorname = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.vlan_id = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.vlan_priority = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.vlan_state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.iface_num = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.mtu = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.port = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.bootproto = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.subnet_mask = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.gateway = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_alt_client_id = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_dns = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_learn_iqn = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_vendor_id_state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_vendor_id = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.dhcp_slp_da = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.fragmentation = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.gratuitous_arp = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.incoming_forwarding = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.tos_state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.tos = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.ttl = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.delayed_ack = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.tcp_nagle = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.tcp_wsf_state = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.tcp_wsf = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.tcp_timer_scale = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.tcp_timestamp = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.redirect = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.def_task_mgmt_timeout = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.header_digest = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.data_digest = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.immediate_data = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.initial_r2t = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.data_seq_inorder = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.data_pdu_inorder = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.erl = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.max_receive_data_len = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.first_burst_len = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.max_outstanding_r2t = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.max_burst_len = 0
Oct 20 18:10:51 user nova-compute[74233]: iface.chap_auth = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.bidi_chap = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.strict_login_compliance = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.discovery_auth = <empty>
Oct 20 18:10:51 user nova-compute[74233]: iface.discovery_logout = <empty>
Oct 20 18:10:51 user nova-compute[74233]: node.discovery_address = <empty>
Oct 20 18:10:51 user nova-compute[74233]: node.discovery_port = 0
Oct 20 18:10:51 user nova-compute[74233]: node.discovery_type = static
Oct 20 18:10:51 user nova-compute[74233]: node.session.initial_cmdsn = 0
Oct 20 18:10:51 user nova-compute[74233]: node.session.initial_login_retry_max = 8
Oct 20 18:10:51 user nova-compute[74233]: node.session.xmit_thread_priority = -20
Oct 20 18:10:51 user nova-compute[74233]: node.session.cmds_max = 128
Oct 20 18:10:51 user nova-compute[74233]: node.session.queue_depth = 32
Oct 20 18:10:51 user nova-compute[74233]: node.session.nr_sessions = 1
Oct 20 18:10:51 user nova-compute[74233]: node.session.auth.authmethod = CHAP
Oct 20 18:10:51 user nova-compute[74233]: node.session.auth.username = bjDxINpY
Oct 20 18:10:51 user nova-compute[74233]: node.session.auth.password = ***
Oct 20 18:10:51 user nova-compute[74233]: node.session.auth.username_in = <empty>
Oct 20 18:10:51 user nova-compute[74233]: node.session.auth.password_in = <empty>
Oct 20 18:10:51 user nova-compute[74233]: node.session.auth.chap_algs = MD5
Oct 20 18:10:51 user nova-compute[74233]: node.session.timeo.replacement_timeout = 120
Oct 20 18:10:51 user nova-compute[74233]: node.session.err_timeo.abort_timeout = 15
Oct 20 18:10:51 user nova-compute[74233]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 18:10:51 user nova-compute[74233]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 18:10:51 user nova-compute[74233]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.FastAbort = Yes
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.InitialR2T = No
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.ImmediateData = Yes
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.MaxConnections = 1
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 18:10:51 user nova-compute[74233]: node.session.iscsi.ERL = 0
Oct 20 18:10:51 user nova-compute[74233]: node.session.scan = manual
Oct 20 18:10:51 user nova-compute[74233]: node.session.reopen_max = 0
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].address = 172.16.0.220
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].port = 3260
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].startup = manual
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].tcp.window_size = 524288
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].tcp.type_of_service = 0
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].timeo.logout_timeout = 15
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].timeo.login_timeout = 15
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].timeo.auth_timeout = 45
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].iscsi.DataDigest = None
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].iscsi.IFMarker = No
Oct 20 18:10:51 user nova-compute[74233]: node.conn[0].iscsi.OFMarker = No
Oct 20 18:10:51 user nova-compute[74233]: # END RECORD
Oct 20 18:10:51 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b041ac8-9e21-4cd6-be0e-d92911940a65]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a91d3-9474-44dc-b648-dbbc8550ccb4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjDxINpY {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjDxINpY" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f79f46-d462-4e11-95d2-41c49be527a5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjDxINpY'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeda2db-ec05-4596-8a88-1549ca3a56a8]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c91fe19-d611-453f-9f90-f131bea1bc7d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:52 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:10:52 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:10:52 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:10:52 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:10:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] HCTL ('34', '0', '0', 0) found on session 9 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3b483-a941-4b5c-a6da-ea0e11e4e238]: (4, ('0 0 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching for a device in session 9 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23061613937336265', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061613937336265', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114649267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114649267',id=11,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-erxct8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:09:42Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=95824943-b9d7-4a42-ba57-56ff4aad7142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "vif_mac": "fa:16:3e:7d:76:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "vif_mac": "fa:16:3e:7d:76:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'pci_devices' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.objects.base [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<95824943-b9d7-4a42-ba57-56ff4aad7142> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:10:52 user nova-compute[74233]:   <uuid>95824943-b9d7-4a42-ba57-56ff4aad7142</uuid>
Oct 20 18:10:52 user nova-compute[74233]:   <name>instance-0000000b</name>
Oct 20 18:10:52 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:10:52 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:10:52 user nova-compute[74233]:   <metadata>
Oct 20 18:10:52 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:10:52 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:10:52 user nova-compute[74233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2114649267</nova:name>
Oct 20 18:10:52 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:10:51</nova:creationTime>
Oct 20 18:10:52 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:10:52 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:10:52 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:10:52 user nova-compute[74233]:       <nova:owner>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:user uuid="a5149d5d6d1f486c87a0c808597a40f3">tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member</nova:user>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:project uuid="8c937ee3474848de8b761d88e32f6447">tempest-ServerBootFromVolumeStableRescueTest-481267461</nova:project>
Oct 20 18:10:52 user nova-compute[74233]:       </nova:owner>
Oct 20 18:10:52 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:10:52 user nova-compute[74233]:       <nova:ports>
Oct 20 18:10:52 user nova-compute[74233]:         <nova:port uuid="e7731480-1384-4cdd-93e3-f63ae477d471">
Oct 20 18:10:52 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:10:52 user nova-compute[74233]:         </nova:port>
Oct 20 18:10:52 user nova-compute[74233]:       </nova:ports>
Oct 20 18:10:52 user nova-compute[74233]:     </nova:instance>
Oct 20 18:10:52 user nova-compute[74233]:   </metadata>
Oct 20 18:10:52 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:10:52 user nova-compute[74233]:     <system>
Oct 20 18:10:52 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:10:52 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:10:52 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:10:52 user nova-compute[74233]:       <entry name="serial">95824943-b9d7-4a42-ba57-56ff4aad7142</entry>
Oct 20 18:10:52 user nova-compute[74233]:       <entry name="uuid">95824943-b9d7-4a42-ba57-56ff4aad7142</entry>
Oct 20 18:10:52 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:10:52 user nova-compute[74233]:     </system>
Oct 20 18:10:52 user nova-compute[74233]:   </sysinfo>
Oct 20 18:10:52 user nova-compute[74233]:   <os>
Oct 20 18:10:52 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:10:52 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:10:52 user nova-compute[74233]:   </os>
Oct 20 18:10:52 user nova-compute[74233]:   <features>
Oct 20 18:10:52 user nova-compute[74233]:     <acpi/>
Oct 20 18:10:52 user nova-compute[74233]:     <apic/>
Oct 20 18:10:52 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:10:52 user nova-compute[74233]:   </features>
Oct 20 18:10:52 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:10:52 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:10:52 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:10:52 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:10:52 user nova-compute[74233]:   </clock>
Oct 20 18:10:52 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:10:52 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:10:52 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:10:52 user nova-compute[74233]:   </cpu>
Oct 20 18:10:52 user nova-compute[74233]:   <devices>
Oct 20 18:10:52 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:10:52 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:10:52 user nova-compute[74233]:       <source dev="/dev/sdc"/>
Oct 20 18:10:52 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:10:52 user nova-compute[74233]:       <serial>d7995a08-6018-45ef-89cd-d30bcfb34fb3</serial>
Oct 20 18:10:52 user nova-compute[74233]:     </disk>
Oct 20 18:10:52 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:10:52 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:10:52 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue"/>
Oct 20 18:10:52 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:10:52 user nova-compute[74233]:       <boot order="1"/>
Oct 20 18:10:52 user nova-compute[74233]:     </disk>
Oct 20 18:10:52 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:10:52 user nova-compute[74233]:       <mac address="fa:16:3e:7d:76:a1"/>
Oct 20 18:10:52 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:10:52 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:10:52 user nova-compute[74233]:       <target dev="tape7731480-13"/>
Oct 20 18:10:52 user nova-compute[74233]:     </interface>
Oct 20 18:10:52 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:10:52 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/console.log" append="off"/>
Oct 20 18:10:52 user nova-compute[74233]:     </serial>
Oct 20 18:10:52 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:10:52 user nova-compute[74233]:     <video>
Oct 20 18:10:52 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:10:52 user nova-compute[74233]:     </video>
Oct 20 18:10:52 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:10:52 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:10:52 user nova-compute[74233]:     </rng>
Oct 20 18:10:52 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:10:52 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:10:52 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:10:52 user nova-compute[74233]:     </memballoon>
Oct 20 18:10:52 user nova-compute[74233]:   </devices>
Oct 20 18:10:52 user nova-compute[74233]: </domain>
Oct 20 18:10:52 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:10:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance destroyed successfully.
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:10:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No VIF found with MAC fa:16:3e:7d:76:a1, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:10:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-bb53be96-10b3-48eb-a8c8-3d0ba3cefd7b req-02623939-5c09-404d-9d6e-8d8ed9a8bbbf service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bb53be96-10b3-48eb-a8c8-3d0ba3cefd7b req-02623939-5c09-404d-9d6e-8d8ed9a8bbbf service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bb53be96-10b3-48eb-a8c8-3d0ba3cefd7b req-02623939-5c09-404d-9d6e-8d8ed9a8bbbf service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bb53be96-10b3-48eb-a8c8-3d0ba3cefd7b req-02623939-5c09-404d-9d6e-8d8ed9a8bbbf service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-bb53be96-10b3-48eb-a8c8-3d0ba3cefd7b req-02623939-5c09-404d-9d6e-8d8ed9a8bbbf service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:54 user nova-compute[74233]: WARNING nova.compute.manager [req-bb53be96-10b3-48eb-a8c8-3d0ba3cefd7b req-02623939-5c09-404d-9d6e-8d8ed9a8bbbf service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-a5bc2c5d-505b-4881-975f-d05a1a076e93 req-e95b2c88-ffdd-414e-a92e-58573c56cd4d service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a5bc2c5d-505b-4881-975f-d05a1a076e93 req-e95b2c88-ffdd-414e-a92e-58573c56cd4d service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a5bc2c5d-505b-4881-975f-d05a1a076e93 req-e95b2c88-ffdd-414e-a92e-58573c56cd4d service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a5bc2c5d-505b-4881-975f-d05a1a076e93 req-e95b2c88-ffdd-414e-a92e-58573c56cd4d service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-a5bc2c5d-505b-4881-975f-d05a1a076e93 req-e95b2c88-ffdd-414e-a92e-58573c56cd4d service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:10:56 user nova-compute[74233]: WARNING nova.compute.manager [req-a5bc2c5d-505b-4881-975f-d05a1a076e93 req-e95b2c88-ffdd-414e-a92e-58573c56cd4d service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state rescuing.
Oct 20 18:10:56 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b4d123df-f2fb-4637-8968-c7ade99eb1e3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'flavor' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:56 user nova-compute[74233]: INFO nova.compute.manager [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attaching volume 0a64ba72-2bc4-4120-9f51-d0fabe20621b to /dev/vdc
Oct 20 18:10:57 user nova-compute[74233]: DEBUG os_brick.utils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[10236d19-72f3-40d9-8c68-50d356d594b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c69a82-5888-4007-95df-0156005d7287]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe3fe3f-f39e-4c7b-886f-0df1b1bd52d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[180a50d4-8ef9-4658-bb1d-8ca94882f08d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:10:57 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[481efbe1-3ea5-491e-8bb3-76c186d7f5fc]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG os_brick.utils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updating existing volume attachment record: ee45c51a-bfb0-4229-ab94-1a8b24f94776 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:10:57 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updating instance_info_cache with network_info: [{"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-4597536a-b485-4bf9-938b-65471258e5e9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:10:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:11:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:11:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.212661743164062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4597536a-b485-4bf9-938b-65471258e5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance da89b953-70b8-4c12-b723-8762eb3b70dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 833aa705-3460-4831-b6f4-e42e3735eee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a9a937ea-ccd4-4502-b13b-09dda73e4156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:11:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:09 user nova-compute[74233]: INFO nova.compute.manager [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Terminating instance
Oct 20 18:11:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Instance destroyed successfully.
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.objects.instance [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lazy-loading 'resources' on Instance uuid da89b953-70b8-4c12-b723-8762eb3b70dd {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1551172276',display_name='tempest-TestVolumeSwap-server-1551172276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1551172276',id=7,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwZRAvVwyB9Xzr3zw+oAFefFNmxUWhNFUELUKfDNkTI9UNBdphhh76ycu4RCAefsgoFx83CIDcw20bLufFhGK729EDcgDNmu8YiDMSewwS7RIMOX2f8erNB+f6x9ivkEw==',key_name='tempest-keypair-2090141118',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a90929f7fd4c42bb87aba9296c3c729b',ramdisk_id='',reservation_id='r-38g17uok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-214752244',owner_user_name='tempest-TestVolumeSwap-214752244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51d30539f2ad4574bc2a7fdfbbb3eec8',uuid=da89b953-70b8-4c12-b723-8762eb3b70dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Converting VIF {"id": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "address": "fa:16:3e:ff:20:54", "network": {"id": "bf8fdb13-fa62-4996-980d-5e7f3ca24e30", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1507410148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90929f7fd4c42bb87aba9296c3c729b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8148999e-78", "ovs_interfaceid": "8148999e-788c-4dff-bbd5-bc78a00d2c88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG os_vif [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8148999e-78, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf09b8fe-2f94-4ff3-a6c9-687230003312) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:11:10 user nova-compute[74233]: INFO os_vif [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:20:54,bridge_name='br-int',has_traffic_filtering=True,id=8148999e-788c-4dff-bbd5-bc78a00d2c88,network=Network(bf8fdb13-fa62-4996-980d-5e7f3ca24e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8148999e-78')
Oct 20 18:11:10 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Deleting instance files /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd_del
Oct 20 18:11:10 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Deletion of /opt/stack/data/nova/instances/da89b953-70b8-4c12-b723-8762eb3b70dd_del complete
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-8b2dbc40-dfa2-409c-850a-3195cb66a8b8 req-b7a66910-f043-4acb-931f-b52a6af46177 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-unplugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8b2dbc40-dfa2-409c-850a-3195cb66a8b8 req-b7a66910-f043-4acb-931f-b52a6af46177 service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8b2dbc40-dfa2-409c-850a-3195cb66a8b8 req-b7a66910-f043-4acb-931f-b52a6af46177 service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8b2dbc40-dfa2-409c-850a-3195cb66a8b8 req-b7a66910-f043-4acb-931f-b52a6af46177 service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-8b2dbc40-dfa2-409c-850a-3195cb66a8b8 req-b7a66910-f043-4acb-931f-b52a6af46177 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-unplugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-8b2dbc40-dfa2-409c-850a-3195cb66a8b8 req-b7a66910-f043-4acb-931f-b52a6af46177 service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-unplugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:11:10 user nova-compute[74233]: INFO nova.compute.manager [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 20 18:11:10 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:11:12 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Took 1.83 seconds to deallocate network for instance.
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: INFO nova.compute.manager [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Terminating instance
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:12 user nova-compute[74233]: WARNING nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state deleted and task_state None.
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:12 user nova-compute[74233]: WARNING nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state deleted and task_state None.
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:12 user nova-compute[74233]: WARNING nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state deleted and task_state None.
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-unplugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-unplugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:12 user nova-compute[74233]: WARNING nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-unplugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state deleted and task_state None.
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Acquiring lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] No waiting events found dispatching network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:12 user nova-compute[74233]: WARNING nova.compute.manager [req-7ab53d3c-5464-4d0e-b9bc-110034df0376 req-2518bf21-e2f5-412d-a6e8-6d6faaa9e80f service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received unexpected event network-vif-plugged-8148999e-788c-4dff-bbd5-bc78a00d2c88 for instance with vm_state deleted and task_state None.
Oct 20 18:11:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-9e54ea0a-05bb-464a-8d21-53d021af16bc req-02024406-cdae-4fcd-be52-d2ab6296d56c service nova] [instance: da89b953-70b8-4c12-b723-8762eb3b70dd] Received event network-vif-deleted-8148999e-788c-4dff-bbd5-bc78a00d2c88 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:11:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:12 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Deleted allocations for instance da89b953-70b8-4c12-b723-8762eb3b70dd
Oct 20 18:11:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-59937b2f-ce39-4b83-8f78-4658a5cf691c tempest-TestVolumeSwap-214752244 tempest-TestVolumeSwap-214752244-project-member] Lock "da89b953-70b8-4c12-b723-8762eb3b70dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.764s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Instance destroyed successfully.
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.objects.instance [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'resources' on Instance uuid 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-2e068b16-73fc-47ff-8e50-e46fd26a7d0c req-f0fb3731-0eab-48f4-b9bf-e56c800fc6f8 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-vif-unplugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2e068b16-73fc-47ff-8e50-e46fd26a7d0c req-f0fb3731-0eab-48f4-b9bf-e56c800fc6f8 service nova] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2e068b16-73fc-47ff-8e50-e46fd26a7d0c req-f0fb3731-0eab-48f4-b9bf-e56c800fc6f8 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2e068b16-73fc-47ff-8e50-e46fd26a7d0c req-f0fb3731-0eab-48f4-b9bf-e56c800fc6f8 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-2e068b16-73fc-47ff-8e50-e46fd26a7d0c req-f0fb3731-0eab-48f4-b9bf-e56c800fc6f8 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] No waiting events found dispatching network-vif-unplugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-2e068b16-73fc-47ff-8e50-e46fd26a7d0c req-f0fb3731-0eab-48f4-b9bf-e56c800fc6f8 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-vif-unplugged-b5309b28-7869-4a97-9e33-baf666deb08a for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173060278',display_name='tempest-AttachVolumeTestJSON-server-1173060278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173060278',id=3,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk0Dmh+OiRtyCxK3x0h+w/wmvMgbfvsUYfdm0YStx4PwucG182aDbbsLUgRpCVRieyntRX6r32P9BA2oZKvrdRe0naKzuiKFaAgF3u/Z2N+YSs6gdXkS4cbCg6z6zhWeg==',key_name='tempest-keypair-272701511',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e5f6324b8b44903af56785a67af93d9',ramdisk_id='',reservation_id='r-fk6pz4az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1002715263',owner_user_name='tempest-AttachVolumeTestJSON-1002715263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c1e18569184b7ca8ce578e5e24bfc6',uuid=1d5ccae4-54fb-4831-bd8a-dce5fc1ef936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converting VIF {"id": "b5309b28-7869-4a97-9e33-baf666deb08a", "address": "fa:16:3e:21:32:9c", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5309b28-78", "ovs_interfaceid": "b5309b28-7869-4a97-9e33-baf666deb08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG os_vif [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5309b28-78, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cef8f0dc-5b94-4f04-905b-37d0043763e4) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:13 user nova-compute[74233]: INFO os_vif [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=b5309b28-7869-4a97-9e33-baf666deb08a,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5309b28-78')
Oct 20 18:11:13 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Deleting instance files /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936_del
Oct 20 18:11:13 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Deletion of /opt/stack/data/nova/instances/1d5ccae4-54fb-4831-bd8a-dce5fc1ef936_del complete
Oct 20 18:11:13 user nova-compute[74233]: INFO nova.compute.manager [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 20 18:11:13 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:11:13 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:11:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:11:15 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Took 1.64 seconds to deallocate network for instance.
Oct 20 18:11:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-f8e1504d-99b0-4125-a9f7-0ee9ce8bc8ae req-69e37633-cd46-4743-9348-03cee311a840 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-vif-deleted-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-8413caf8-6863-444b-bdcc-a9edf2a541a9 req-f52dcfa6-8971-4e97-ab92-768cc18c4ab6 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received event network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8413caf8-6863-444b-bdcc-a9edf2a541a9 req-f52dcfa6-8971-4e97-ab92-768cc18c4ab6 service nova] Acquiring lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8413caf8-6863-444b-bdcc-a9edf2a541a9 req-f52dcfa6-8971-4e97-ab92-768cc18c4ab6 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8413caf8-6863-444b-bdcc-a9edf2a541a9 req-f52dcfa6-8971-4e97-ab92-768cc18c4ab6 service nova] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-8413caf8-6863-444b-bdcc-a9edf2a541a9 req-f52dcfa6-8971-4e97-ab92-768cc18c4ab6 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] No waiting events found dispatching network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:15 user nova-compute[74233]: WARNING nova.compute.manager [req-8413caf8-6863-444b-bdcc-a9edf2a541a9 req-f52dcfa6-8971-4e97-ab92-768cc18c4ab6 service nova] [instance: 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936] Received unexpected event network-vif-plugged-b5309b28-7869-4a97-9e33-baf666deb08a for instance with vm_state deleted and task_state None.
Oct 20 18:11:15 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:15 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Deleted allocations for instance 1d5ccae4-54fb-4831-bd8a-dce5fc1ef936
Oct 20 18:11:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-44954dad-745b-4be3-be01-e202ecb29fd3 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "1d5ccae4-54fb-4831-bd8a-dce5fc1ef936" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.144s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAtCNiES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:11:17 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:11:17 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:11:17 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ae7db-b0b4-408c-b6b6-9c1223a5f27f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:11:17 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec63853-5f4d-4f52-9857-60f7749b744a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b] added
Oct 20 18:11:17 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e4322-01b5-4f1b-8f18-0bd6294e4608]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cdbdee-67cc-46ef-ac56-c84a1175909a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAtCNiES {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAtCNiES" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd202a-26f0-4b7f-b3ed-56f301fc3bea]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAtCNiES'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[00039e78-5458-4542-b908-fc7a2b38b4e1]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9598ca5a-1972-44a6-adf0-7cbea5f4ab79]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab92f78-2260-483a-8ddf-f228dee3b63d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260]
Oct 20 18:11:17 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260] successful.
Oct 20 18:11:17 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd73048-7e32-400f-b1c5-468cd7ca933a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a967499-9f05-45e8-9e88-f16558353bbb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b (non-flash)
Oct 20 18:11:17 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:11:17 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0764966-68c0-4e63-9df3-9ad2e5fae7ef]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:17 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAtCNiES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23865616439613364', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865616439613364', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'flavor' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:11:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:11:18 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:11:18 user nova-compute[74233]:   <source dev="/dev/sde"/>
Oct 20 18:11:18 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:11:18 user nova-compute[74233]:   <serial>0a64ba72-2bc4-4120-9f51-d0fabe20621b</serial>
Oct 20 18:11:18 user nova-compute[74233]: </disk>
Oct 20 18:11:18 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:11:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:11:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:11:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:11:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] No VIF found with MAC fa:16:3e:6d:6d:46, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:11:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b05fc777-4f4e-488a-9adc-17feaf875dc9 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.416s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:20 user nova-compute[74233]: INFO nova.compute.manager [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Detaching volume 0a64ba72-2bc4-4120-9f51-d0fabe20621b
Oct 20 18:11:20 user nova-compute[74233]: INFO nova.virt.block_device [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attempting to driver detach volume 0a64ba72-2bc4-4120-9f51-d0fabe20621b from mountpoint /dev/vdc
Oct 20 18:11:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Attempting to detach device vdc from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:11:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:11:20 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:11:20 user nova-compute[74233]:   <source dev="/dev/sde"/>
Oct 20 18:11:20 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:11:20 user nova-compute[74233]:   <serial>0a64ba72-2bc4-4120-9f51-d0fabe20621b</serial>
Oct 20 18:11:20 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 18:11:20 user nova-compute[74233]: </disk>
Oct 20 18:11:20 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:11:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Successfully detached device vdc from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the persistent domain config.
Oct 20 18:11:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:11:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:11:20 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:11:20 user nova-compute[74233]:   <source dev="/dev/sde"/>
Oct 20 18:11:20 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:11:20 user nova-compute[74233]:   <serial>0a64ba72-2bc4-4120-9f51-d0fabe20621b</serial>
Oct 20 18:11:20 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 18:11:20 user nova-compute[74233]: </disk>
Oct 20 18:11:20 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:11:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:11:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:39 user nova-compute[74233]: INFO nova.compute.manager [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Terminating instance
Oct 20 18:11:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-2bbf7b22-5b5e-48d1-a3e9-4e2e85a0828b req-38572dd4-c286-49ab-8f1c-2fa76e998a50 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-vif-unplugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2bbf7b22-5b5e-48d1-a3e9-4e2e85a0828b req-38572dd4-c286-49ab-8f1c-2fa76e998a50 service nova] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2bbf7b22-5b5e-48d1-a3e9-4e2e85a0828b req-38572dd4-c286-49ab-8f1c-2fa76e998a50 service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2bbf7b22-5b5e-48d1-a3e9-4e2e85a0828b req-38572dd4-c286-49ab-8f1c-2fa76e998a50 service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-2bbf7b22-5b5e-48d1-a3e9-4e2e85a0828b req-38572dd4-c286-49ab-8f1c-2fa76e998a50 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] No waiting events found dispatching network-vif-unplugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-2bbf7b22-5b5e-48d1-a3e9-4e2e85a0828b req-38572dd4-c286-49ab-8f1c-2fa76e998a50 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-vif-unplugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:11:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Instance destroyed successfully.
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'resources' on Instance uuid a9a937ea-ccd4-4502-b13b-09dda73e4156 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-907902911',display_name='tempest-VolumesAdminNegativeTest-server-907902911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-907902911',id=12,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:09:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2110b7ff17d146d1b97f0daea38053f2',ramdisk_id='',reservation_id='r-7c094hjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-842591383',owner_user_name='tempest-VolumesAdminNegativeTest-842591383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:09:33Z,user_data=None,user_id='ef4c6280b548459599c60b88672a963c',uuid=a9a937ea-ccd4-4502-b13b-09dda73e4156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converting VIF {"id": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "address": "fa:16:3e:ed:f7:dc", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb96d6831-a1", "ovs_interfaceid": "b96d6831-a11c-47e3-a9c7-ed2529ba1cb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_vif [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb96d6831-a1, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d3fa7b3-65c9-4583-9b09-442276f7207f) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:11:40 user nova-compute[74233]: INFO os_vif [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=b96d6831-a11c-47e3-a9c7-ed2529ba1cb7,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb96d6831-a1')
Oct 20 18:11:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Deleting instance files /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156_del
Oct 20 18:11:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Deletion of /opt/stack/data/nova/instances/a9a937ea-ccd4-4502-b13b-09dda73e4156_del complete
Oct 20 18:11:40 user nova-compute[74233]: INFO nova.compute.manager [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:11:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 833aa705-3460-4831-b6f4-e42e3735eee3 is timed out.
Oct 20 18:11:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Successfully detached device vdc from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the live domain config.
Oct 20 18:11:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAtCNiES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:11:40 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33bb9ab-f5cd-4b73-9ffd-ba1c69c8d586]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:11:40 user nova-compute[74233]: No targets found.
Oct 20 18:11:40 user nova-compute[74233]: iSNS:
Oct 20 18:11:40 user nova-compute[74233]: No targets found.
Oct 20 18:11:40 user nova-compute[74233]: STATIC:
Oct 20 18:11:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b
Oct 20 18:11:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:11:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:11:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:11:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:11:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:11:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec
Oct 20 18:11:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:11:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:11:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:11:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:11:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:11:40 user nova-compute[74233]: FIRMWARE:
Oct 20 18:11:40 user nova-compute[74233]: No targets found.
Oct 20 18:11:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:11:40 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:11:40 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d2775-0efa-4072-82e4-173aef640843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46127c2-f1a6-404b-95c9-990b009bf762]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:11:40 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:11:40 user nova-compute[74233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b (non-flash)
Oct 20 18:11:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:11:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:11:40 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:11:40 user nova-compute[74233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b (non-flash)
Oct 20 18:11:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:11:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb981b73d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea845ae8-1ae8-442f-9403-cc5550bee2d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25117311-4b66-4f1c-861d-9173a80c7569]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7483679-7bb4-433b-b261-aaf092be1a26]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[718aa0fc-2d82-4e10-bc16-d5ef080e9fb2]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f08551-04b6-4656-aed8-357a2ab4f3df]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dbe162-05ca-4f66-a7d0-d5cd15bba8c8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260]
Oct 20 18:11:41 user nova-compute[74233]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b, portal: 172.16.0.220,3260] successful.
Oct 20 18:11:41 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a64ba72-2bc4-4120-9f51-d0fabe20621b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e1ef1-6435-4a5e-8bd9-ab708a187454]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] <== disconnect_volume: return (343ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:11:41 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Took 0.57 seconds to deallocate network for instance.
Oct 20 18:11:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-6c33fc03-cb5f-4d4f-840c-786e59da0c7d req-7a5135d6-22bd-4782-9e2c-89c0c44187f9 service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-vif-deleted-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:41 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Deleted allocations for instance a9a937ea-ccd4-4502-b13b-09dda73e4156
Oct 20 18:11:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d467e40c-2cf3-4c47-b572-468b886566a0 tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-2191d233-9610-412b-993f-25db271bc946 req-e291ace2-f20c-411d-832b-9e6c24a3b4cc service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received event network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2191d233-9610-412b-993f-25db271bc946 req-e291ace2-f20c-411d-832b-9e6c24a3b4cc service nova] Acquiring lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2191d233-9610-412b-993f-25db271bc946 req-e291ace2-f20c-411d-832b-9e6c24a3b4cc service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2191d233-9610-412b-993f-25db271bc946 req-e291ace2-f20c-411d-832b-9e6c24a3b4cc service nova] Lock "a9a937ea-ccd4-4502-b13b-09dda73e4156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-2191d233-9610-412b-993f-25db271bc946 req-e291ace2-f20c-411d-832b-9e6c24a3b4cc service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] No waiting events found dispatching network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:42 user nova-compute[74233]: WARNING nova.compute.manager [req-2191d233-9610-412b-993f-25db271bc946 req-e291ace2-f20c-411d-832b-9e6c24a3b4cc service nova] [instance: a9a937ea-ccd4-4502-b13b-09dda73e4156] Received unexpected event network-vif-plugged-b96d6831-a11c-47e3-a9c7-ed2529ba1cb7 for instance with vm_state deleted and task_state None.
Oct 20 18:11:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:11:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:11:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'flavor' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afabaf5d-3fe5-4b6c-b660-46f4cc7e7758 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.397s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:11:49 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:50 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:51 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:11:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:11:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:11:57 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:11:57 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8054MB free_disk=25.28772735595703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:57 user nova-compute[74233]: INFO nova.compute.manager [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Unrescuing
Oct 20 18:11:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4597536a-b485-4bf9-938b-65471258e5e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 833aa705-3460-4831-b6f4-e42e3735eee3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:11:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing instance network info cache due to event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.objects.instance [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'flavor' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-9e943403-9bed-4ffa-900d-ba7859db24f7 req-209fc56f-960c-4cda-a564-30ada38474b6 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9e943403-9bed-4ffa-900d-ba7859db24f7 req-209fc56f-960c-4cda-a564-30ada38474b6 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9e943403-9bed-4ffa-900d-ba7859db24f7 req-209fc56f-960c-4cda-a564-30ada38474b6 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9e943403-9bed-4ffa-900d-ba7859db24f7 req-209fc56f-960c-4cda-a564-30ada38474b6 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:11:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-9e943403-9bed-4ffa-900d-ba7859db24f7 req-209fc56f-960c-4cda-a564-30ada38474b6 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:11:58 user nova-compute[74233]: WARNING nova.compute.manager [req-9e943403-9bed-4ffa-900d-ba7859db24f7 req-209fc56f-960c-4cda-a564-30ada38474b6 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:11:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updated VIF entry in instance network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:11:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:11:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-93ea6635-d43c-44ff-851a-e30b453537bf req-775fbce2-bcba-4b4c-a99d-462f8c6d075a service nova] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:11:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance destroyed successfully.
Oct 20 18:11:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing instance network info cache due to event network-changed-7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] Acquiring lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] Acquired lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG nova.network.neutron [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Refreshing network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-f34ecd9b-16dd-4991-a61c-5d02446dcb14 req-74cfe8fe-ebe4-48cc-a160-c7906bc080d0 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f34ecd9b-16dd-4991-a61c-5d02446dcb14 req-74cfe8fe-ebe4-48cc-a160-c7906bc080d0 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f34ecd9b-16dd-4991-a61c-5d02446dcb14 req-74cfe8fe-ebe4-48cc-a160-c7906bc080d0 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f34ecd9b-16dd-4991-a61c-5d02446dcb14 req-74cfe8fe-ebe4-48cc-a160-c7906bc080d0 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-f34ecd9b-16dd-4991-a61c-5d02446dcb14 req-74cfe8fe-ebe4-48cc-a160-c7906bc080d0 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:00 user nova-compute[74233]: WARNING nova.compute.manager [req-f34ecd9b-16dd-4991-a61c-5d02446dcb14 req-74cfe8fe-ebe4-48cc-a160-c7906bc080d0 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:12:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updated VIF entry in instance network info cache for port 7371e3fd-09e0-43d8-8468-61178a7cffc4. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:12:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [{"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72892aec-e900-4cb6-ac6e-2c83f2a2bb8b req-ba5401c5-1bdc-4321-84fa-b9d649de92a5 service nova] Releasing lock "refresh_cache-787cb236-6ef6-4366-a564-9d85d17914f0" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:02 user nova-compute[74233]: WARNING nova.compute.manager [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:12:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:02 user nova-compute[74233]: WARNING nova.compute.manager [req-88de61a7-7f67-4498-b6af-018946b1581d req-577170ac-cd4d-4ba0-ada0-580813e6dca4 service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:12:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95c3214e-af01-47b9-bfc8-27ac2057a0a9 tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:12:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:12:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:12:07 user nova-compute[74233]: INFO nova.compute.claims [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Claim successful on node user
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:12:08 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.policy [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74c1e18569184b7ca8ce578e5e24bfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5f6324b8b44903af56785a67af93d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:12:08 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Creating image(s)
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "/opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "/opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "/opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk 1073741824" returned: 0 in 0.071s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.242s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Successfully created port: 6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Cannot resize image /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Ensure instance console log exists: /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Successfully updated port: 6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquired lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-changed-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Refreshing instance network info cache due to event network-changed-6424d183-3ff0-49be-b22f-8515a0dbf3df. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] Acquiring lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating instance_info_cache with network_info: [{"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Releasing lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Instance network_info: |[{"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] Acquired lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Refreshing network info cache for port 6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Start _get_guest_xml network_info=[{"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:12:10 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:12:10 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1895803143',display_name='tempest-AttachVolumeTestJSON-server-1895803143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1895803143',id=14,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg9x+zDJZioZ1a8QO7SCPl2mKBPKXtqdZsUfdP67oXIa/wEkPo7W0AzUyTT6997Kdof4hyXGmzZpQLf1JQ3bhfoLc0AZJ4wHYovRQBHfMOqgs5L5pWIXI0RA+UV0IRbAg==',key_name='tempest-keypair-73485482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e5f6324b8b44903af56785a67af93d9',ramdisk_id='',reservation_id='r-zx7v9wty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1002715263',owner_user_name='tempest-AttachVolumeTestJSON-1002715263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c1e18569184b7ca8ce578e5e24bfc6',uuid=38f3b094-18c4-492a-bb68-fc687012e0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converting VIF {"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'pci_devices' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:12:10 user nova-compute[74233]:   <uuid>38f3b094-18c4-492a-bb68-fc687012e0ce</uuid>
Oct 20 18:12:10 user nova-compute[74233]:   <name>instance-0000000e</name>
Oct 20 18:12:10 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:12:10 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:12:10 user nova-compute[74233]:   <metadata>
Oct 20 18:12:10 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:12:10 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:12:10 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeTestJSON-server-1895803143</nova:name>
Oct 20 18:12:10 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:12:10</nova:creationTime>
Oct 20 18:12:10 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:12:10 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:12:10 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:12:10 user nova-compute[74233]:       <nova:owner>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:user uuid="74c1e18569184b7ca8ce578e5e24bfc6">tempest-AttachVolumeTestJSON-1002715263-project-member</nova:user>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:project uuid="7e5f6324b8b44903af56785a67af93d9">tempest-AttachVolumeTestJSON-1002715263</nova:project>
Oct 20 18:12:10 user nova-compute[74233]:       </nova:owner>
Oct 20 18:12:10 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:12:10 user nova-compute[74233]:       <nova:ports>
Oct 20 18:12:10 user nova-compute[74233]:         <nova:port uuid="6424d183-3ff0-49be-b22f-8515a0dbf3df">
Oct 20 18:12:10 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:12:10 user nova-compute[74233]:         </nova:port>
Oct 20 18:12:10 user nova-compute[74233]:       </nova:ports>
Oct 20 18:12:10 user nova-compute[74233]:     </nova:instance>
Oct 20 18:12:10 user nova-compute[74233]:   </metadata>
Oct 20 18:12:10 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:12:10 user nova-compute[74233]:     <system>
Oct 20 18:12:10 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:12:10 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:12:10 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:12:10 user nova-compute[74233]:       <entry name="serial">38f3b094-18c4-492a-bb68-fc687012e0ce</entry>
Oct 20 18:12:10 user nova-compute[74233]:       <entry name="uuid">38f3b094-18c4-492a-bb68-fc687012e0ce</entry>
Oct 20 18:12:10 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:12:10 user nova-compute[74233]:     </system>
Oct 20 18:12:10 user nova-compute[74233]:   </sysinfo>
Oct 20 18:12:10 user nova-compute[74233]:   <os>
Oct 20 18:12:10 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:12:10 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:12:10 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:12:10 user nova-compute[74233]:   </os>
Oct 20 18:12:10 user nova-compute[74233]:   <features>
Oct 20 18:12:10 user nova-compute[74233]:     <acpi/>
Oct 20 18:12:10 user nova-compute[74233]:     <apic/>
Oct 20 18:12:10 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:12:10 user nova-compute[74233]:   </features>
Oct 20 18:12:10 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:12:10 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:12:10 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:12:10 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:12:10 user nova-compute[74233]:   </clock>
Oct 20 18:12:10 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:12:10 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:12:10 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:12:10 user nova-compute[74233]:   </cpu>
Oct 20 18:12:10 user nova-compute[74233]:   <devices>
Oct 20 18:12:10 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:12:10 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:12:10 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk"/>
Oct 20 18:12:10 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:12:10 user nova-compute[74233]:     </disk>
Oct 20 18:12:10 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:12:10 user nova-compute[74233]:       <mac address="fa:16:3e:a2:57:02"/>
Oct 20 18:12:10 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:12:10 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:12:10 user nova-compute[74233]:       <target dev="tap6424d183-3f"/>
Oct 20 18:12:10 user nova-compute[74233]:     </interface>
Oct 20 18:12:10 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:12:10 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/console.log" append="off"/>
Oct 20 18:12:10 user nova-compute[74233]:     </serial>
Oct 20 18:12:10 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:12:10 user nova-compute[74233]:     <video>
Oct 20 18:12:10 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:12:10 user nova-compute[74233]:     </video>
Oct 20 18:12:10 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:12:10 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:12:10 user nova-compute[74233]:     </rng>
Oct 20 18:12:10 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:12:10 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:12:10 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:12:10 user nova-compute[74233]:     </memballoon>
Oct 20 18:12:10 user nova-compute[74233]:   </devices>
Oct 20 18:12:10 user nova-compute[74233]: </domain>
Oct 20 18:12:10 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1895803143',display_name='tempest-AttachVolumeTestJSON-server-1895803143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1895803143',id=14,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg9x+zDJZioZ1a8QO7SCPl2mKBPKXtqdZsUfdP67oXIa/wEkPo7W0AzUyTT6997Kdof4hyXGmzZpQLf1JQ3bhfoLc0AZJ4wHYovRQBHfMOqgs5L5pWIXI0RA+UV0IRbAg==',key_name='tempest-keypair-73485482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e5f6324b8b44903af56785a67af93d9',ramdisk_id='',reservation_id='r-zx7v9wty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1002715263',owner_user_name='tempest-AttachVolumeTestJSON-1002715263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c1e18569184b7ca8ce578e5e24bfc6',uuid=38f3b094-18c4-492a-bb68-fc687012e0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converting VIF {"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG os_vif [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '470a087b-651f-516f-afa2-d4778dbf365a', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6424d183-3f, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6424d183-3f, col_values=(('qos', UUID('4889a6a9-d497-4180-8ac5-fe241820b312')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6424d183-3f, col_values=(('external_ids', {'iface-id': '6424d183-3ff0-49be-b22f-8515a0dbf3df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:57:02', 'vm-uuid': '38f3b094-18c4-492a-bb68-fc687012e0ce'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:10 user nova-compute[74233]: INFO os_vif [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f')
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No VIF found with MAC fa:16:3e:a2:57:02, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:10 user nova-compute[74233]: INFO nova.compute.manager [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Detaching volume bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec
Oct 20 18:12:11 user nova-compute[74233]: INFO nova.virt.block_device [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Attempting to driver detach volume bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec from mountpoint /dev/vdb
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Attempting to detach device vdb from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:12:11 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:12:11 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:12:11 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:12:11 user nova-compute[74233]:   <serial>bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec</serial>
Oct 20 18:12:11 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:12:11 user nova-compute[74233]: </disk>
Oct 20 18:12:11 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:12:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Successfully detached device vdb from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the persistent domain config.
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:12:11 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:12:11 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:12:11 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:12:11 user nova-compute[74233]:   <serial>bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec</serial>
Oct 20 18:12:11 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:12:11 user nova-compute[74233]: </disk>
Oct 20 18:12:11 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updated VIF entry in instance network info cache for port 6424d183-3ff0-49be-b22f-8515a0dbf3df. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating instance_info_cache with network_info: [{"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0d55db1f-518c-419f-8635-086fdd4daf1f req-ffc27fe4-376b-46f0-8f62-42b523dbfbd6 service nova] Releasing lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:12:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-b874e596-eca0-4c40-b915-5e82e8f71920 req-0cfc1e5a-9601-4218-a863-a70174d8557c service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b874e596-eca0-4c40-b915-5e82e8f71920 req-0cfc1e5a-9601-4218-a863-a70174d8557c service nova] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b874e596-eca0-4c40-b915-5e82e8f71920 req-0cfc1e5a-9601-4218-a863-a70174d8557c service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b874e596-eca0-4c40-b915-5e82e8f71920 req-0cfc1e5a-9601-4218-a863-a70174d8557c service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-b874e596-eca0-4c40-b915-5e82e8f71920 req-0cfc1e5a-9601-4218-a863-a70174d8557c service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] No waiting events found dispatching network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:13 user nova-compute[74233]: WARNING nova.compute.manager [req-b874e596-eca0-4c40-b915-5e82e8f71920 req-0cfc1e5a-9601-4218-a863-a70174d8557c service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received unexpected event network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df for instance with vm_state building and task_state spawning.
Oct 20 18:12:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-c7ec5ea5-784d-4bce-9bbc-01f167290e85 req-de88f6da-09a6-4bb6-bdd8-187c79063c7b service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c7ec5ea5-784d-4bce-9bbc-01f167290e85 req-de88f6da-09a6-4bb6-bdd8-187c79063c7b service nova] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c7ec5ea5-784d-4bce-9bbc-01f167290e85 req-de88f6da-09a6-4bb6-bdd8-187c79063c7b service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c7ec5ea5-784d-4bce-9bbc-01f167290e85 req-de88f6da-09a6-4bb6-bdd8-187c79063c7b service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-c7ec5ea5-784d-4bce-9bbc-01f167290e85 req-de88f6da-09a6-4bb6-bdd8-187c79063c7b service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] No waiting events found dispatching network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:15 user nova-compute[74233]: WARNING nova.compute.manager [req-c7ec5ea5-784d-4bce-9bbc-01f167290e85 req-de88f6da-09a6-4bb6-bdd8-187c79063c7b service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received unexpected event network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df for instance with vm_state building and task_state spawning.
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:12:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Instance spawned successfully.
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:15 user nova-compute[74233]: INFO nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Took 7.03 seconds to spawn the instance on the hypervisor.
Oct 20 18:12:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:12:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:15 user nova-compute[74233]: INFO nova.compute.manager [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Took 8.11 seconds to build instance.
Oct 20 18:12:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6852934-ee52-4f25-965c-4efc727b763c tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.263s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:12:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:12:25 user nova-compute[74233]: INFO nova.compute.claims [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Claim successful on node user
Oct 20 18:12:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:12:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.policy [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02bbe839e32f41268676839457c3abbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d20ec6bba044fb8aff5094ac65ac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:12:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Creating image(s)
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "/opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "/opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.227s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.265s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Successfully created port: 5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:12:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk 1073741824" returned: 0 in 0.058s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Cannot resize image /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Ensure instance console log exists: /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Successfully updated port: 5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "refresh_cache-9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquired lock "refresh_cache-9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-changed-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Refreshing instance network info cache due to event network-changed-5745e3db-96fa-45ce-af18-162b321702cd. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] Acquiring lock "refresh_cache-9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Updating instance_info_cache with network_info: [{"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Releasing lock "refresh_cache-9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Instance network_info: |[{"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] Acquired lock "refresh_cache-9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Refreshing network info cache for port 5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Start _get_guest_xml network_info=[{"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:12:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:12:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-9204685',display_name='tempest-ServersNegativeTestJSON-server-9204685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-9204685',id=15,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d20ec6bba044fb8aff5094ac65ac52',ramdisk_id='',reservation_id='r-n7dyvad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-627903216',owner_user_name='tempest-ServersNegativeTestJSON-627903216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:26Z,user_data=None,user_id='02bbe839e32f41268676839457c3abbd',uuid=9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converting VIF {"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:12:28 user nova-compute[74233]:   <uuid>9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf</uuid>
Oct 20 18:12:28 user nova-compute[74233]:   <name>instance-0000000f</name>
Oct 20 18:12:28 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:12:28 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:12:28 user nova-compute[74233]:   <metadata>
Oct 20 18:12:28 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:12:28 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:12:28 user nova-compute[74233]:       <nova:name>tempest-ServersNegativeTestJSON-server-9204685</nova:name>
Oct 20 18:12:28 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:12:28</nova:creationTime>
Oct 20 18:12:28 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:12:28 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:12:28 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:12:28 user nova-compute[74233]:       <nova:owner>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:user uuid="02bbe839e32f41268676839457c3abbd">tempest-ServersNegativeTestJSON-627903216-project-member</nova:user>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:project uuid="75d20ec6bba044fb8aff5094ac65ac52">tempest-ServersNegativeTestJSON-627903216</nova:project>
Oct 20 18:12:28 user nova-compute[74233]:       </nova:owner>
Oct 20 18:12:28 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:12:28 user nova-compute[74233]:       <nova:ports>
Oct 20 18:12:28 user nova-compute[74233]:         <nova:port uuid="5745e3db-96fa-45ce-af18-162b321702cd">
Oct 20 18:12:28 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 18:12:28 user nova-compute[74233]:         </nova:port>
Oct 20 18:12:28 user nova-compute[74233]:       </nova:ports>
Oct 20 18:12:28 user nova-compute[74233]:     </nova:instance>
Oct 20 18:12:28 user nova-compute[74233]:   </metadata>
Oct 20 18:12:28 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:12:28 user nova-compute[74233]:     <system>
Oct 20 18:12:28 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:12:28 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:12:28 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:12:28 user nova-compute[74233]:       <entry name="serial">9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf</entry>
Oct 20 18:12:28 user nova-compute[74233]:       <entry name="uuid">9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf</entry>
Oct 20 18:12:28 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:12:28 user nova-compute[74233]:     </system>
Oct 20 18:12:28 user nova-compute[74233]:   </sysinfo>
Oct 20 18:12:28 user nova-compute[74233]:   <os>
Oct 20 18:12:28 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:12:28 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:12:28 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:12:28 user nova-compute[74233]:   </os>
Oct 20 18:12:28 user nova-compute[74233]:   <features>
Oct 20 18:12:28 user nova-compute[74233]:     <acpi/>
Oct 20 18:12:28 user nova-compute[74233]:     <apic/>
Oct 20 18:12:28 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:12:28 user nova-compute[74233]:   </features>
Oct 20 18:12:28 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:12:28 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:12:28 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:12:28 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:12:28 user nova-compute[74233]:   </clock>
Oct 20 18:12:28 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:12:28 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:12:28 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:12:28 user nova-compute[74233]:   </cpu>
Oct 20 18:12:28 user nova-compute[74233]:   <devices>
Oct 20 18:12:28 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:12:28 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:12:28 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk"/>
Oct 20 18:12:28 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:12:28 user nova-compute[74233]:     </disk>
Oct 20 18:12:28 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:12:28 user nova-compute[74233]:       <mac address="fa:16:3e:4f:fb:98"/>
Oct 20 18:12:28 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:12:28 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:12:28 user nova-compute[74233]:       <target dev="tap5745e3db-96"/>
Oct 20 18:12:28 user nova-compute[74233]:     </interface>
Oct 20 18:12:28 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:12:28 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/console.log" append="off"/>
Oct 20 18:12:28 user nova-compute[74233]:     </serial>
Oct 20 18:12:28 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:12:28 user nova-compute[74233]:     <video>
Oct 20 18:12:28 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:12:28 user nova-compute[74233]:     </video>
Oct 20 18:12:28 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:12:28 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:12:28 user nova-compute[74233]:     </rng>
Oct 20 18:12:28 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:12:28 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:12:28 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:12:28 user nova-compute[74233]:     </memballoon>
Oct 20 18:12:28 user nova-compute[74233]:   </devices>
Oct 20 18:12:28 user nova-compute[74233]: </domain>
Oct 20 18:12:28 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-9204685',display_name='tempest-ServersNegativeTestJSON-server-9204685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-9204685',id=15,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d20ec6bba044fb8aff5094ac65ac52',ramdisk_id='',reservation_id='r-n7dyvad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-627903216',owner_user_name='tempest-ServersNegativeTestJSON-627903216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:26Z,user_data=None,user_id='02bbe839e32f41268676839457c3abbd',uuid=9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converting VIF {"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG os_vif [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ae9a9a3-d06c-5341-8e1a-e07891eff494', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5745e3db-96, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5745e3db-96, col_values=(('qos', UUID('8e301b42-b362-439e-9558-8f23d7ab1f1a')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5745e3db-96, col_values=(('external_ids', {'iface-id': '5745e3db-96fa-45ce-af18-162b321702cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:fb:98', 'vm-uuid': '9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:28 user nova-compute[74233]: INFO os_vif [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96')
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:12:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] No VIF found with MAC fa:16:3e:4f:fb:98, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG nova.network.neutron [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Updated VIF entry in instance network info cache for port 5745e3db-96fa-45ce-af18-162b321702cd. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG nova.network.neutron [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Updating instance_info_cache with network_info: [{"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ecb6860a-0f91-413e-abb7-e7cf8681cbae req-b2d2e87c-4e57-43f2-a756-d0eb830430db service nova] Releasing lock "refresh_cache-9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:29 user nova-compute[74233]: INFO nova.compute.manager [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Detaching volume db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:12:29 user nova-compute[74233]: INFO nova.virt.block_device [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Attempting to driver detach volume db3cd346-9eb5-4d9d-8aac-a3009ce79e15 from mountpoint /dev/vdb
Oct 20 18:12:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Attempting to detach device vdb from instance 787cb236-6ef6-4366-a564-9d85d17914f0 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:12:29 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:12:29 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:12:29 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:12:29 user nova-compute[74233]:   <serial>db3cd346-9eb5-4d9d-8aac-a3009ce79e15</serial>
Oct 20 18:12:29 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:12:29 user nova-compute[74233]: </disk>
Oct 20 18:12:29 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:12:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Successfully detached device vdb from instance 787cb236-6ef6-4366-a564-9d85d17914f0 from the persistent domain config.
Oct 20 18:12:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 787cb236-6ef6-4366-a564-9d85d17914f0 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:12:29 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:12:29 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:12:29 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:12:29 user nova-compute[74233]:   <serial>db3cd346-9eb5-4d9d-8aac-a3009ce79e15</serial>
Oct 20 18:12:29 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:12:29 user nova-compute[74233]: </disk>
Oct 20 18:12:29 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-3bf13337-1106-4996-b184-00cd5447bea7 req-ce8d5204-64e1-46df-b95b-10763145c5e9 service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3bf13337-1106-4996-b184-00cd5447bea7 req-ce8d5204-64e1-46df-b95b-10763145c5e9 service nova] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3bf13337-1106-4996-b184-00cd5447bea7 req-ce8d5204-64e1-46df-b95b-10763145c5e9 service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3bf13337-1106-4996-b184-00cd5447bea7 req-ce8d5204-64e1-46df-b95b-10763145c5e9 service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-3bf13337-1106-4996-b184-00cd5447bea7 req-ce8d5204-64e1-46df-b95b-10763145c5e9 service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] No waiting events found dispatching network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:30 user nova-compute[74233]: WARNING nova.compute.manager [req-3bf13337-1106-4996-b184-00cd5447bea7 req-ce8d5204-64e1-46df-b95b-10763145c5e9 service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received unexpected event network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd for instance with vm_state building and task_state spawning.
Oct 20 18:12:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:31 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 833aa705-3460-4831-b6f4-e42e3735eee3 is timed out.
Oct 20 18:12:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Successfully detached device vdb from instance 833aa705-3460-4831-b6f4-e42e3735eee3 from the live domain config.
Oct 20 18:12:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:12:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJPEVIKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:12:31 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:12:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:12:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:12:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[706d28f2-1fcf-453d-94fe-bca440fea0a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:12:32 user nova-compute[74233]: No targets found.
Oct 20 18:12:32 user nova-compute[74233]: iSNS:
Oct 20 18:12:32 user nova-compute[74233]: No targets found.
Oct 20 18:12:32 user nova-compute[74233]: STATIC:
Oct 20 18:12:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:12:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:12:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:12:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec
Oct 20 18:12:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:12:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:12:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:12:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:12:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:12:32 user nova-compute[74233]: FIRMWARE:
Oct 20 18:12:32 user nova-compute[74233]: No targets found.
Oct 20 18:12:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:12:32 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:12:32 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43d361e-8b94-43bd-a183-68284b7fa4bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f51496-624e-4450-89d6-62c4377e98ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:12:32 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:12:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:12:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:12:32 user nova-compute[74233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec (non-flash)
Oct 20 18:12:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:12:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9506736d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2903f-ba0a-4504-ae13-b7d2571bc5e0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[09337c17-32ea-4f43-922c-4a44347040cd]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c87a0b-43ee-4683-af78-4f8db2d24fcb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[083ccd87-4f37-42ea-a20a-3c0ae181b3b9]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e824438-d445-4f7a-b14a-8cc286ec1812]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd4fed-4fc9-4cb0-8d28-7ac5f7c50bee]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260]
Oct 20 18:12:32 user nova-compute[74233]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec, portal: 172.16.0.220,3260] successful.
Oct 20 18:12:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5fcdb0-9283-4bd7-9f55-59c5e081d4ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fddbb8-d62e-4946-aa1e-282575929e73]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] <== disconnect_volume: return (350ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-44056af7-b4b5-4444-9008-c5802ef0dfae req-d0cfcd8d-2bb1-4442-a993-3e4a4b3ef75f service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-44056af7-b4b5-4444-9008-c5802ef0dfae req-d0cfcd8d-2bb1-4442-a993-3e4a4b3ef75f service nova] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-44056af7-b4b5-4444-9008-c5802ef0dfae req-d0cfcd8d-2bb1-4442-a993-3e4a4b3ef75f service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-44056af7-b4b5-4444-9008-c5802ef0dfae req-d0cfcd8d-2bb1-4442-a993-3e4a4b3ef75f service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-44056af7-b4b5-4444-9008-c5802ef0dfae req-d0cfcd8d-2bb1-4442-a993-3e4a4b3ef75f service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] No waiting events found dispatching network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:32 user nova-compute[74233]: WARNING nova.compute.manager [req-44056af7-b4b5-4444-9008-c5802ef0dfae req-d0cfcd8d-2bb1-4442-a993-3e4a4b3ef75f service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received unexpected event network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd for instance with vm_state building and task_state spawning.
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:12:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Instance spawned successfully.
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:12:32 user nova-compute[74233]: INFO nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Took 6.13 seconds to spawn the instance on the hypervisor.
Oct 20 18:12:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:12:32 user nova-compute[74233]: INFO nova.compute.manager [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Took 7.16 seconds to build instance.
Oct 20 18:12:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-47eaf99d-712b-4091-8676-1ae4f3d9e17c tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.280s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:33 user nova-compute[74233]: DEBUG nova.objects.instance [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'flavor' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-06de1293-b551-4873-81b1-31a442bf325b tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.568s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:39 user nova-compute[74233]: INFO nova.compute.manager [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Unrescuing
Oct 20 18:12:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:12:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'flavor' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance destroyed successfully.
Oct 20 18:12:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-a94627d6-8282-426a-8241-a438f90bec17 req-3f6fa8a2-4e03-42cc-af6a-243140aeeb62 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a94627d6-8282-426a-8241-a438f90bec17 req-3f6fa8a2-4e03-42cc-af6a-243140aeeb62 service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a94627d6-8282-426a-8241-a438f90bec17 req-3f6fa8a2-4e03-42cc-af6a-243140aeeb62 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a94627d6-8282-426a-8241-a438f90bec17 req-3f6fa8a2-4e03-42cc-af6a-243140aeeb62 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-a94627d6-8282-426a-8241-a438f90bec17 req-3f6fa8a2-4e03-42cc-af6a-243140aeeb62 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:41 user nova-compute[74233]: WARNING nova.compute.manager [req-a94627d6-8282-426a-8241-a438f90bec17 req-3f6fa8a2-4e03-42cc-af6a-243140aeeb62 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:41 user nova-compute[74233]: INFO nova.compute.manager [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Terminating instance
Oct 20 18:12:41 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ae62478-06e6-4b48-ba10-be9a8e68f9a1 req-af20b328-f15b-42ca-902c-45ea6bfca2af service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-unplugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ae62478-06e6-4b48-ba10-be9a8e68f9a1 req-af20b328-f15b-42ca-902c-45ea6bfca2af service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ae62478-06e6-4b48-ba10-be9a8e68f9a1 req-af20b328-f15b-42ca-902c-45ea6bfca2af service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ae62478-06e6-4b48-ba10-be9a8e68f9a1 req-af20b328-f15b-42ca-902c-45ea6bfca2af service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ae62478-06e6-4b48-ba10-be9a8e68f9a1 req-af20b328-f15b-42ca-902c-45ea6bfca2af service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-unplugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ae62478-06e6-4b48-ba10-be9a8e68f9a1 req-af20b328-f15b-42ca-902c-45ea6bfca2af service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-unplugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:12:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Instance destroyed successfully.
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lazy-loading 'resources' on Instance uuid 4597536a-b485-4bf9-938b-65471258e5e9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-8a6e84c9-77cf-48f1-b587-443ad055c831 req-de58a240-8f17-4d45-b45e-e75af8066ee6 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a6e84c9-77cf-48f1-b587-443ad055c831 req-de58a240-8f17-4d45-b45e-e75af8066ee6 service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a6e84c9-77cf-48f1-b587-443ad055c831 req-de58a240-8f17-4d45-b45e-e75af8066ee6 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a6e84c9-77cf-48f1-b587-443ad055c831 req-de58a240-8f17-4d45-b45e-e75af8066ee6 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-8a6e84c9-77cf-48f1-b587-443ad055c831 req-de58a240-8f17-4d45-b45e-e75af8066ee6 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:43 user nova-compute[74233]: WARNING nova.compute.manager [req-8a6e84c9-77cf-48f1-b587-443ad055c831 req-de58a240-8f17-4d45-b45e-e75af8066ee6 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1020487361',display_name='tempest-VolumesAdminNegativeTest-server-1020487361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1020487361',id=5,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVMG9wgc9Q06cVIGm5DJnnT0QWIltH3+z3bfzWdQh4Od6U6zzY5zjWUrTaKsQnmBqao5Hiwb8yZy1rtlLncnRi0MCZEx8V3AiZ4ZLn7PNOr/rO9lxNZJCCif/plYXw/OQ==',key_name='tempest-keypair-1350926343',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2110b7ff17d146d1b97f0daea38053f2',ramdisk_id='',reservation_id='r-1apv7x92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-842591383',owner_user_name='tempest-VolumesAdminNegativeTest-842591383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4c6280b548459599c60b88672a963c',uuid=4597536a-b485-4bf9-938b-65471258e5e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converting VIF {"id": "bf24bab0-51aa-4996-b37d-df67798591c3", "address": "fa:16:3e:5d:2b:59", "network": {"id": "f40af79f-2354-4e0c-a6a8-26a73b26df41", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1913189962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2110b7ff17d146d1b97f0daea38053f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf24bab0-51", "ovs_interfaceid": "bf24bab0-51aa-4996-b37d-df67798591c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG os_vif [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf24bab0-51, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcae175f-5c53-434e-8903-bd9f20cffb68) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:43 user nova-compute[74233]: INFO os_vif [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:59,bridge_name='br-int',has_traffic_filtering=True,id=bf24bab0-51aa-4996-b37d-df67798591c3,network=Network(f40af79f-2354-4e0c-a6a8-26a73b26df41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf24bab0-51')
Oct 20 18:12:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Deleting instance files /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9_del
Oct 20 18:12:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Deletion of /opt/stack/data/nova/instances/4597536a-b485-4bf9-938b-65471258e5e9_del complete
Oct 20 18:12:43 user nova-compute[74233]: INFO nova.compute.manager [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Took 2.18 seconds to destroy the instance on the hypervisor.
Oct 20 18:12:43 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:12:43 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:44 user nova-compute[74233]: WARNING nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received unexpected event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with vm_state active and task_state deleting.
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:44 user nova-compute[74233]: WARNING nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received unexpected event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with vm_state active and task_state deleting.
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:44 user nova-compute[74233]: WARNING nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received unexpected event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with vm_state active and task_state deleting.
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-unplugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-unplugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-108fec73-1704-4aa2-86bf-7bb81a933637 req-b45e7981-1ff6-48b9-a92e-b4ec5dc49b92 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-unplugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:45 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:45 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Took 1.56 seconds to deallocate network for instance.
Oct 20 18:12:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-2373de14-1c75-4af5-9e59-73cf2039d0fb req-4cba9ee2-c70c-49d7-8ed0-dc819bb15383 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-deleted-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d15cd2bc-60f9-48d1-9f79-89c0a26bebb8 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:46 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Deleted allocations for instance 4597536a-b485-4bf9-938b-65471258e5e9
Oct 20 18:12:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a444bfcd-64e3-4369-8b60-0dfafeb076ad tempest-VolumesAdminNegativeTest-842591383 tempest-VolumesAdminNegativeTest-842591383-project-member] Lock "4597536a-b485-4bf9-938b-65471258e5e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.612s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-f60ff95c-2243-416f-8080-81842eb2aa57 req-f655dcff-3517-4774-a85b-6af067e0f750 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f60ff95c-2243-416f-8080-81842eb2aa57 req-f655dcff-3517-4774-a85b-6af067e0f750 service nova] Acquiring lock "4597536a-b485-4bf9-938b-65471258e5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f60ff95c-2243-416f-8080-81842eb2aa57 req-f655dcff-3517-4774-a85b-6af067e0f750 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f60ff95c-2243-416f-8080-81842eb2aa57 req-f655dcff-3517-4774-a85b-6af067e0f750 service nova] Lock "4597536a-b485-4bf9-938b-65471258e5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-f60ff95c-2243-416f-8080-81842eb2aa57 req-f655dcff-3517-4774-a85b-6af067e0f750 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] No waiting events found dispatching network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:46 user nova-compute[74233]: WARNING nova.compute.manager [req-f60ff95c-2243-416f-8080-81842eb2aa57 req-f655dcff-3517-4774-a85b-6af067e0f750 service nova] [instance: 4597536a-b485-4bf9-938b-65471258e5e9] Received unexpected event network-vif-plugged-bf24bab0-51aa-4996-b37d-df67798591c3 for instance with vm_state deleted and task_state None.
Oct 20 18:12:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:47 user nova-compute[74233]: WARNING nova.compute.manager [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state None.
Oct 20 18:12:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:12:47 user nova-compute[74233]: WARNING nova.compute.manager [req-bd64600a-59d0-4251-976e-60f5f1adbeae req-7766b843-e27e-422f-80ef-9f605e9864da service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state None.
Oct 20 18:12:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:50 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 787cb236-6ef6-4366-a564-9d85d17914f0 is timed out.
Oct 20 18:12:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Successfully detached device vdb from instance 787cb236-6ef6-4366-a564-9d85d17914f0 from the live domain config.
Oct 20 18:12:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hskFqLJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:12:50 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50cb3a8-ef4a-490d-87b6-534f01f8fb3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:12:50 user nova-compute[74233]: No targets found.
Oct 20 18:12:50 user nova-compute[74233]: iSNS:
Oct 20 18:12:50 user nova-compute[74233]: No targets found.
Oct 20 18:12:50 user nova-compute[74233]: STATIC:
Oct 20 18:12:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15
Oct 20 18:12:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:12:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:12:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:12:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:12:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:12:50 user nova-compute[74233]: FIRMWARE:
Oct 20 18:12:50 user nova-compute[74233]: No targets found.
Oct 20 18:12:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:12:50 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:12:50 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[732eb8fd-11c4-4a70-94ac-c18d4908fbd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d298374-708d-406f-bc4e-9525869ddb5e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:12:50 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:12:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 (non-flash)
Oct 20 18:12:50 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:12:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6097881a-c035-48a5-acd2-fc158aac650b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8686d6-5a90-4344-ace2-f90b03e49859]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9d847-a119-4a2e-a8f2-53e9c60cc6eb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d4376f-0b56-4537-a942-ff42860803ef]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae08528c-6f5e-49b1-bf72-ca5eb15ef2c8]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b249920-f9d4-4d4b-8204-855e3ee26be5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260]
Oct 20 18:12:50 user nova-compute[74233]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15, portal: 172.16.0.220,3260] successful.
Oct 20 18:12:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db3cd346-9eb5-4d9d-8aac-a3009ce79e15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4b176-4ef6-4f82-a26f-bcc5762c0b8c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] <== disconnect_volume: return (354ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:12:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:12:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:12:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "947602c4-d7be-446e-87bc-b0137ac37f36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:12:55 user nova-compute[74233]: INFO nova.compute.claims [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Claim successful on node user
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'flavor' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5fc30ab9-43bf-4064-9739-cca7ed772dca tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.194s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:12:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: WARNING nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid c309386c-5cca-46e0-96b9-754e82d47e3e {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 947602c4-d7be-446e-87bc-b0137ac37f36 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:12:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:12:55 user nova-compute[74233]: INFO nova.virt.block_device [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Booting with volume 40148486-b5b3-489d-934c-21f389d51176 at /dev/vda
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG nova.policy [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4faad54e08c645dc89cc14332c6b6838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0effbd2489472d8c0f0661b4349e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG os_brick.utils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d5eb00-26ba-4ab4-8330-aa641764b21b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e2717-5116-49d5-bbea-d61a85c89449]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5507b300-5eb2-4ed2-841a-8cd570785e97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52c81e-abd1-4ee7-98da-26494e34254c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:12:56 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28808726-09fa-4a89-8c90-7951f85f24cc]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG os_brick.utils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating existing volume attachment record: 3c46517c-9f8a-4f80-b394-29f072613c52 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:56 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully created port: cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully created port: d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully created port: 4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:12:59 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:12:59 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=25.227874755859375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 787cb236-6ef6-4366-a564-9d85d17914f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 833aa705-3460-4831-b6f4-e42e3735eee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 38f3b094-18c4-492a-bb68-fc687012e0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 947602c4-d7be-446e-87bc-b0137ac37f36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dbb80f53-2ced-431d-9315-c911c6b72f4c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:12:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.168s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:13:00 user nova-compute[74233]: INFO nova.compute.claims [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Claim successful on node user
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully created port: 05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:13:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:13:00 user nova-compute[74233]: INFO nova.virt.block_device [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Booting with volume 03601032-c5fc-4181-95bb-e1e278d2839d at /dev/vda
Oct 20 18:13:00 user nova-compute[74233]: DEBUG nova.policy [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10447188fbd74b18ba64fc8e64d267c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b592b103d8084815bf6d3132c1215feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG os_brick.utils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe89e53-dd60-44eb-9770-8b78a158e9e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1454ec43-c00e-457d-8944-26d9d0664417]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e3f62-1efb-4f79-aa51-7197a9989c3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61209111-9e02-425d-9dbd-669cfe834e37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully created port: b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:13:01 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f3433-ab08-45c9-8919-c8c0307ef655]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG os_brick.utils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updating existing volume attachment record: d197c352-5a73-48e0-bf18-952228f70dd6 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:01 user nova-compute[74233]: INFO nova.compute.manager [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Terminating instance
Oct 20 18:13:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-20416019-9e06-4691-94a7-8e53b8176367 req-81f42f4d-1a3d-45c7-ad14-1421183e3cc2 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-vif-unplugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-20416019-9e06-4691-94a7-8e53b8176367 req-81f42f4d-1a3d-45c7-ad14-1421183e3cc2 service nova] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-20416019-9e06-4691-94a7-8e53b8176367 req-81f42f4d-1a3d-45c7-ad14-1421183e3cc2 service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-20416019-9e06-4691-94a7-8e53b8176367 req-81f42f4d-1a3d-45c7-ad14-1421183e3cc2 service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-20416019-9e06-4691-94a7-8e53b8176367 req-81f42f4d-1a3d-45c7-ad14-1421183e3cc2 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] No waiting events found dispatching network-vif-unplugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-20416019-9e06-4691-94a7-8e53b8176367 req-81f42f4d-1a3d-45c7-ad14-1421183e3cc2 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-vif-unplugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:13:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Instance destroyed successfully.
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.objects.instance [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lazy-loading 'resources' on Instance uuid 833aa705-3460-4831-b6f4-e42e3735eee3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1495294645',display_name='tempest-TestServerVolumeAttachmentScenario-server-1495294645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1495294645',id=9,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHc05HvYnkXHyS/avUfjPrXQg3Ap/EYAr3rdFZjx4E9+QQMIgzKahQKW/KupkeoXlkY3ejdiOfsiwIDXtvBWlIMEI9e2ESktrmFYLwlwPHJTnh4FrWCASHldfbOFvN/9g==',key_name='tempest-keypair-1563450852',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:08:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b618b17f70d4adbb2e54ec79e7b2937',ramdisk_id='',reservation_id='r-iga18hu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1498332361',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1498332361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52a5f40bf784389834d852435a5e757',uuid=833aa705-3460-4831-b6f4-e42e3735eee3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Converting VIF {"id": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "address": "fa:16:3e:6d:6d:46", "network": {"id": "ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-428609575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b618b17f70d4adbb2e54ec79e7b2937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b1cba4f-5c", "ovs_interfaceid": "8b1cba4f-5c21-4ca1-acd3-865fb68f060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG os_vif [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b1cba4f-5c, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32991b79-eab6-4356-b252-08ad2e10ddff) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:02 user nova-compute[74233]: INFO os_vif [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:6d:46,bridge_name='br-int',has_traffic_filtering=True,id=8b1cba4f-5c21-4ca1-acd3-865fb68f060a,network=Network(ccafdaa8-7ad4-4224-a92f-47a3bae3cfb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b1cba4f-5c')
Oct 20 18:13:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Deleting instance files /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3_del
Oct 20 18:13:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Deletion of /opt/stack/data/nova/instances/833aa705-3460-4831-b6f4-e42e3735eee3_del complete
Oct 20 18:13:02 user nova-compute[74233]: INFO nova.compute.manager [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 18:13:02 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Successfully created port: d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:13:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:03 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Took 1.41 seconds to deallocate network for instance.
Oct 20 18:13:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-87c1ffdb-7bce-4f2c-b01b-c70a3f593fe0 req-bdd85108-43ac-49ef-9e5a-42c1317d76c2 service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-vif-deleted-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Successfully updated port: d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquired lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:13:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:04 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Deleted allocations for instance 833aa705-3460-4831-b6f4-e42e3735eee3
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received event network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Acquiring lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Lock "833aa705-3460-4831-b6f4-e42e3735eee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] No waiting events found dispatching network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:04 user nova-compute[74233]: WARNING nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 833aa705-3460-4831-b6f4-e42e3735eee3] Received unexpected event network-vif-plugged-8b1cba4f-5c21-4ca1-acd3-865fb68f060a for instance with vm_state deleted and task_state None.
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-cd431c77-ddfd-406f-a2c5-fae2ce2523dd. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-41bd15bc-0f32-405c-b45c-fd4018c60177 tempest-TestServerVolumeAttachmentScenario-1498332361 tempest-TestServerVolumeAttachmentScenario-1498332361-project-member] Lock "833aa705-3460-4831-b6f4-e42e3735eee3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.006s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updating instance_info_cache with network_info: [{"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Releasing lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Instance network_info: |[{"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-changed-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Refreshing instance network info cache due to event network-changed-d361737e-8157-4051-9970-4ac903ac279b. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Acquiring lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Acquired lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Refreshing network info cache for port d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: 89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updated VIF entry in instance network info cache for port d361737e-8157-4051-9970-4ac903ac279b. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updating instance_info_cache with network_info: [{"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd001b99-21e3-466b-8c6d-bac2a5b57e97 req-075c41c8-0e42-436e-8b30-7dbcefc2343e service nova] Releasing lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:13:06 user nova-compute[74233]: INFO nova.compute.claims [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Claim successful on node user
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-ca61b8dd-439a-48ef-9be7-73c94df5d3ec. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:13:06 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.policy [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bc0d56bcb4244c4a8f15522ca7fc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241507110dbc42719d74f9c1c8795d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-89a2575d-107e-4825-84d4-1dac010e112a. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port 89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:13:06 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Creating image(s)
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: 4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-d4d5b7c5-29fc-4cd6-a355-808cf6f24765. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.252s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.237s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.network.neutron [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk 1073741824" returned: 0 in 0.061s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cc9cb99d-368a-4f27-b464-4fbaf8038078 req-b73f0735-318e-4300-86a7-2fdbbdd49d8d service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Cannot resize image /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Ensure instance console log exists: /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:07 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Successfully created port: e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: 05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-4048936f-0e3b-44c2-a850-c31201c29593. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port 4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-05589e7f-2a3d-4e36-b55b-ad3f3b07184b. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port 05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08cbf1f0-4d9d-4c19-92ed-35abe8aedf87 req-ab0f80df-9e97-4200-9382-62b8618f41e0 service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Successfully updated port: e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquired lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Successfully updated port: b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Releasing lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Instance network_info: |[{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Start _get_guest_xml network_info=[{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:13:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:13:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'pci_devices' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:13:09 user nova-compute[74233]:   <uuid>e0124740-defc-4aff-9a68-9c3604f1d3c9</uuid>
Oct 20 18:13:09 user nova-compute[74233]:   <name>instance-00000012</name>
Oct 20 18:13:09 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:13:09 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:13:09 user nova-compute[74233]:   <metadata>
Oct 20 18:13:09 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:13:09 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:13:09 user nova-compute[74233]:       <nova:name>tempest-device-tagging-server-1201646160</nova:name>
Oct 20 18:13:09 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:13:09</nova:creationTime>
Oct 20 18:13:09 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:13:09 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:13:09 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:13:09 user nova-compute[74233]:       <nova:owner>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:user uuid="1bc0d56bcb4244c4a8f15522ca7fc78a">tempest-TaggedAttachmentsTest-1226898318-project-member</nova:user>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:project uuid="241507110dbc42719d74f9c1c8795d7f">tempest-TaggedAttachmentsTest-1226898318</nova:project>
Oct 20 18:13:09 user nova-compute[74233]:       </nova:owner>
Oct 20 18:13:09 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:13:09 user nova-compute[74233]:       <nova:ports>
Oct 20 18:13:09 user nova-compute[74233]:         <nova:port uuid="e1d6651b-0fe2-47f6-ba08-7d8db7c28342">
Oct 20 18:13:09 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:13:09 user nova-compute[74233]:         </nova:port>
Oct 20 18:13:09 user nova-compute[74233]:       </nova:ports>
Oct 20 18:13:09 user nova-compute[74233]:     </nova:instance>
Oct 20 18:13:09 user nova-compute[74233]:   </metadata>
Oct 20 18:13:09 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:13:09 user nova-compute[74233]:     <system>
Oct 20 18:13:09 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:13:09 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:13:09 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:13:09 user nova-compute[74233]:       <entry name="serial">e0124740-defc-4aff-9a68-9c3604f1d3c9</entry>
Oct 20 18:13:09 user nova-compute[74233]:       <entry name="uuid">e0124740-defc-4aff-9a68-9c3604f1d3c9</entry>
Oct 20 18:13:09 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:13:09 user nova-compute[74233]:     </system>
Oct 20 18:13:09 user nova-compute[74233]:   </sysinfo>
Oct 20 18:13:09 user nova-compute[74233]:   <os>
Oct 20 18:13:09 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:13:09 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:13:09 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:13:09 user nova-compute[74233]:   </os>
Oct 20 18:13:09 user nova-compute[74233]:   <features>
Oct 20 18:13:09 user nova-compute[74233]:     <acpi/>
Oct 20 18:13:09 user nova-compute[74233]:     <apic/>
Oct 20 18:13:09 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:13:09 user nova-compute[74233]:   </features>
Oct 20 18:13:09 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:13:09 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:13:09 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:13:09 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:13:09 user nova-compute[74233]:   </clock>
Oct 20 18:13:09 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:13:09 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:13:09 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:13:09 user nova-compute[74233]:   </cpu>
Oct 20 18:13:09 user nova-compute[74233]:   <devices>
Oct 20 18:13:09 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:13:09 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:13:09 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk"/>
Oct 20 18:13:09 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:13:09 user nova-compute[74233]:     </disk>
Oct 20 18:13:09 user nova-compute[74233]:     <disk type="file" device="cdrom">
Oct 20 18:13:09 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 18:13:09 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.config"/>
Oct 20 18:13:09 user nova-compute[74233]:       <target dev="hda" bus="ide"/>
Oct 20 18:13:09 user nova-compute[74233]:     </disk>
Oct 20 18:13:09 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:13:09 user nova-compute[74233]:       <mac address="fa:16:3e:77:e9:45"/>
Oct 20 18:13:09 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:13:09 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:13:09 user nova-compute[74233]:       <target dev="tape1d6651b-0f"/>
Oct 20 18:13:09 user nova-compute[74233]:     </interface>
Oct 20 18:13:09 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:13:09 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/console.log" append="off"/>
Oct 20 18:13:09 user nova-compute[74233]:     </serial>
Oct 20 18:13:09 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:13:09 user nova-compute[74233]:     <video>
Oct 20 18:13:09 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:13:09 user nova-compute[74233]:     </video>
Oct 20 18:13:09 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:13:09 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:13:09 user nova-compute[74233]:     </rng>
Oct 20 18:13:09 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:13:09 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:13:09 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:13:09 user nova-compute[74233]:     </memballoon>
Oct 20 18:13:09 user nova-compute[74233]:   </devices>
Oct 20 18:13:09 user nova-compute[74233]: </domain>
Oct 20 18:13:09 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG os_vif [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f8846e3-b384-5899-adcf-db61856df883', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d6651b-0f, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1d6651b-0f, col_values=(('qos', UUID('77e5fb44-ed52-46ce-9c32-4cbaf83fb29a')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1d6651b-0f, col_values=(('external_ids', {'iface-id': 'e1d6651b-0fe2-47f6-ba08-7d8db7c28342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:e9:45', 'vm-uuid': 'e0124740-defc-4aff-9a68-9c3604f1d3c9'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:09 user nova-compute[74233]: INFO os_vif [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f')
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No BDM found with device name hda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:13:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No VIF found with MAC fa:16:3e:77:e9:45, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:13:09 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Using config drive
Oct 20 18:13:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:10 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Creating config drive at /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.config
Oct 20 18:13:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjo5ghq14 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-changed-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Refreshing instance network info cache due to event network-changed-e1d6651b-0fe2-47f6-ba08-7d8db7c28342. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] Acquiring lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] Acquired lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Refreshing network info cache for port e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjo5ghq14" returned: 0 in 0.071s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updated VIF entry in instance network info cache for port e1d6651b-0fe2-47f6-ba08-7d8db7c28342. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] Releasing lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-b7e9e9de-30cd-4372-a8c8-6ec480fc3520. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-ca8b7ec6-8d14-43ea-b50e-863e8430e638 req-865614f2-b3d0-4d64-85f2-47a3a56971e9 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ca8b7ec6-8d14-43ea-b50e-863e8430e638 req-865614f2-b3d0-4d64-85f2-47a3a56971e9 service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ca8b7ec6-8d14-43ea-b50e-863e8430e638 req-865614f2-b3d0-4d64-85f2-47a3a56971e9 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ca8b7ec6-8d14-43ea-b50e-863e8430e638 req-865614f2-b3d0-4d64-85f2-47a3a56971e9 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-ca8b7ec6-8d14-43ea-b50e-863e8430e638 req-865614f2-b3d0-4d64-85f2-47a3a56971e9 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:12 user nova-compute[74233]: WARNING nova.compute.manager [req-ca8b7ec6-8d14-43ea-b50e-863e8430e638 req-865614f2-b3d0-4d64-85f2-47a3a56971e9 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 for instance with vm_state building and task_state spawning.
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [{"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance network_info: |[{"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.network.neutron [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.network.neutron [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updated VIF entry in instance network info cache for port b7e9e9de-30cd-4372-a8c8-6ec480fc3520. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG nova.network.neutron [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [{"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3e87892-2807-486b-a650-9da3485b5815 req-decdc022-c0d0-4a4e-a1d3-afd3b0b4910e service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:13:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Instance spawned successfully.
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-95972181-ca85-4502-b521-7ab18a3af09a req-0f5043a0-e553-4cd0-a3a6-b52a2552266a service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-95972181-ca85-4502-b521-7ab18a3af09a req-0f5043a0-e553-4cd0-a3a6-b52a2552266a service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-95972181-ca85-4502-b521-7ab18a3af09a req-0f5043a0-e553-4cd0-a3a6-b52a2552266a service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-95972181-ca85-4502-b521-7ab18a3af09a req-0f5043a0-e553-4cd0-a3a6-b52a2552266a service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-95972181-ca85-4502-b521-7ab18a3af09a req-0f5043a0-e553-4cd0-a3a6-b52a2552266a service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:14 user nova-compute[74233]: WARNING nova.compute.manager [req-95972181-ca85-4502-b521-7ab18a3af09a req-0f5043a0-e553-4cd0-a3a6-b52a2552266a service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 for instance with vm_state building and task_state spawning.
Oct 20 18:13:14 user nova-compute[74233]: INFO nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Took 7.64 seconds to spawn the instance on the hypervisor.
Oct 20 18:13:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:13:14 user nova-compute[74233]: INFO nova.compute.manager [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Took 8.54 seconds to build instance.
Oct 20 18:13:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c71b0452-7818-4a7b-9247-5cea90fac960 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.655s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:20 user nova-compute[74233]: INFO nova.compute.manager [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Terminating instance
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-947cbfcc-440c-4f06-979f-5f4bae19c569 req-d918350a-d9a8-4fd4-9777-a3e58d38b9ae service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-947cbfcc-440c-4f06-979f-5f4bae19c569 req-d918350a-d9a8-4fd4-9777-a3e58d38b9ae service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-947cbfcc-440c-4f06-979f-5f4bae19c569 req-d918350a-d9a8-4fd4-9777-a3e58d38b9ae service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-947cbfcc-440c-4f06-979f-5f4bae19c569 req-d918350a-d9a8-4fd4-9777-a3e58d38b9ae service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-947cbfcc-440c-4f06-979f-5f4bae19c569 req-d918350a-d9a8-4fd4-9777-a3e58d38b9ae service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-947cbfcc-440c-4f06-979f-5f4bae19c569 req-d918350a-d9a8-4fd4-9777-a3e58d38b9ae service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-unplugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Instance destroyed successfully.
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.objects.instance [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lazy-loading 'resources' on Instance uuid 787cb236-6ef6-4366-a564-9d85d17914f0 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1799510366',display_name='tempest-ServerStableDeviceRescueTest-server-1799510366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1799510366',id=4,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWAzatv9vgWsTaQRaMw733k1HcQFUPs/2CdZmpTrrnaVx5jCahzct2xVjsdAoOw923F+CvNnKuXVCic8N+GGORLyN22CLzYBi6Iqg7X9YSJ6YDZTQhz9DsFEfeoo9ysAg==',key_name='tempest-keypair-1389511728',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4438cc27f48243beacf618702f82de4b',ramdisk_id='',reservation_id='r-df0slk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2000827243',owner_user_name='tempest-ServerStableDeviceRescueTest-2000827243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5880cc8b27b4906a89d92f4fc4c2d05',uuid=787cb236-6ef6-4366-a564-9d85d17914f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converting VIF {"id": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "address": "fa:16:3e:8e:7e:86", "network": {"id": "da73d79a-54dc-4426-a635-52a7f2e664e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1690661325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4438cc27f48243beacf618702f82de4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7371e3fd-09", "ovs_interfaceid": "7371e3fd-09e0-43d8-8468-61178a7cffc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG os_vif [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7371e3fd-09, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e46641ca-86ca-4ce3-9e9b-1e8002bb7815) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:20 user nova-compute[74233]: INFO os_vif [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=7371e3fd-09e0-43d8-8468-61178a7cffc4,network=Network(da73d79a-54dc-4426-a635-52a7f2e664e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7371e3fd-09')
Oct 20 18:13:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Deleting instance files /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0_del
Oct 20 18:13:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Deletion of /opt/stack/data/nova/instances/787cb236-6ef6-4366-a564-9d85d17914f0_del complete
Oct 20 18:13:21 user nova-compute[74233]: INFO nova.compute.manager [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 18:13:21 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:13:21 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:13:21 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:13:21 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:21 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Took 0.78 seconds to deallocate network for instance.
Oct 20 18:13:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:22 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Deleted allocations for instance 787cb236-6ef6-4366-a564-9d85d17914f0
Oct 20 18:13:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] Acquiring lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] Lock "787cb236-6ef6-4366-a564-9d85d17914f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] No waiting events found dispatching network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:22 user nova-compute[74233]: WARNING nova.compute.manager [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received unexpected event network-vif-plugged-7371e3fd-09e0-43d8-8468-61178a7cffc4 for instance with vm_state deleted and task_state None.
Oct 20 18:13:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-549c48a5-58cf-45d9-b772-f953dc325bdf req-f596017e-8e70-4296-bc3b-c07e8468069d service nova] [instance: 787cb236-6ef6-4366-a564-9d85d17914f0] Received event network-vif-deleted-7371e3fd-09e0-43d8-8468-61178a7cffc4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-65881169-8dc5-439a-88d9-19c00910775f tempest-ServerStableDeviceRescueTest-2000827243 tempest-ServerStableDeviceRescueTest-2000827243-project-member] Lock "787cb236-6ef6-4366-a564-9d85d17914f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:33 user nova-compute[74233]: INFO nova.virt.block_device [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Booting with volume e328c698-0f86-40c4-b403-c7e1c965d20d at /dev/vdb
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.utils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:13:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Creating image(s)
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Ensure instance console log exists: /opt/stack/data/nova/instances/dbb80f53-2ced-431d-9315-c911c6b72f4c/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Start _get_guest_xml network_info=[{"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'd197c352-5a73-48e0-bf18-952228f70dd6', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twpzxyeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbb80f53-2ced-431d-9315-c911c6b72f4c', 'attached_at': '', 'detached_at': '', 'volume_id': '03601032-c5fc-4181-95bb-e1e278d2839d', 'serial': '03601032-c5fc-4181-95bb-e1e278d2839d'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[437fddf0-a828-44dc-977c-df4255c9ad13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:13:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twpzxyeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:13:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:13:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:13:34 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b210e-4512-486b-a82c-54bd432c1fd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[addfcbef-d41c-4ef5-aab4-6299ae72f424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e248bf0-d784-4e0c-992d-ca75e4b4c3a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd7ee4d-ed24-4fc1-8d8f-4b48933e81de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:13:34 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:13:34 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ecdc0-37a4-4aa5-ba1a-03d00a40aa35]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.utils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating existing volume attachment record: 075c6bda-8410-4d94-84ee-04cd4aa3da7d {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f759c84-9ff1-4331-addb-dc2ab3ad7d5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d] added
Oct 20 18:13:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe91952-7fc1-46a9-830a-5ae7ad6f41bf]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.192s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e431b7f2-4f42-4afb-90ff-2ca8c946dbf4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twpzxyeV {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twpzxyeV" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605682e-1298-4eb5-8722-c929d3124071]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'twpzxyeV'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a74ed-2eb0-4184-b9a5-dd862ef2df87]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d692ab5-3217-453b-bd2f-d5b065cfe0fd]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:13:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:13:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de780f1-18c2-463f-8fea-cf29f539d7f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260]
Oct 20 18:13:34 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260] successful.
Oct 20 18:13:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca7a71-5670-4d52-92d7-55fde22b9259]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb87f37-1a68-4eb6-baf2-a5911231fc62]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:13:34 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:13:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:13:34 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:13:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.537s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de2af6-5f1b-488d-857a-09231e8aa997]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:13:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twpzxyeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== connect_volume: return (1573ms) {'type': 'block', 'scsi_wwn': '26637333761663465', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637333761663465', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-155631481',display_name='tempest-TestVolumeBootPattern-volume-backed-server-155631481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-155631481',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVmr2OcM4FDbAFDFJteCMtYaJoRuZTDzcZOs4FASKSmDJCL6u/lq356Vec0P0GBcmqFYdwvLosHY5HyeBOamEKUfvc8TuRduqZa6Y9XOUBLD8WoGfghrMn4w1FmwdEC6Q==',key_name='tempest-keypair-635002540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-l4tg6399',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=dbb80f53-2ced-431d-9315-c911c6b72f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.objects.instance [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'pci_devices' on Instance uuid dbb80f53-2ced-431d-9315-c911c6b72f4c {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:13:35 user nova-compute[74233]:   <uuid>dbb80f53-2ced-431d-9315-c911c6b72f4c</uuid>
Oct 20 18:13:35 user nova-compute[74233]:   <name>instance-00000011</name>
Oct 20 18:13:35 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:13:35 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:13:35 user nova-compute[74233]:   <metadata>
Oct 20 18:13:35 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:13:35 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:13:35 user nova-compute[74233]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-155631481</nova:name>
Oct 20 18:13:35 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:13:34</nova:creationTime>
Oct 20 18:13:35 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:13:35 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:13:35 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:13:35 user nova-compute[74233]:       <nova:owner>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:user uuid="10447188fbd74b18ba64fc8e64d267c6">tempest-TestVolumeBootPattern-2006411708-project-member</nova:user>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:project uuid="b592b103d8084815bf6d3132c1215feb">tempest-TestVolumeBootPattern-2006411708</nova:project>
Oct 20 18:13:35 user nova-compute[74233]:       </nova:owner>
Oct 20 18:13:35 user nova-compute[74233]:       <nova:ports>
Oct 20 18:13:35 user nova-compute[74233]:         <nova:port uuid="d361737e-8157-4051-9970-4ac903ac279b">
Oct 20 18:13:35 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:13:35 user nova-compute[74233]:         </nova:port>
Oct 20 18:13:35 user nova-compute[74233]:       </nova:ports>
Oct 20 18:13:35 user nova-compute[74233]:     </nova:instance>
Oct 20 18:13:35 user nova-compute[74233]:   </metadata>
Oct 20 18:13:35 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:13:35 user nova-compute[74233]:     <system>
Oct 20 18:13:35 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:13:35 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:13:35 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:13:35 user nova-compute[74233]:       <entry name="serial">dbb80f53-2ced-431d-9315-c911c6b72f4c</entry>
Oct 20 18:13:35 user nova-compute[74233]:       <entry name="uuid">dbb80f53-2ced-431d-9315-c911c6b72f4c</entry>
Oct 20 18:13:35 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:13:35 user nova-compute[74233]:     </system>
Oct 20 18:13:35 user nova-compute[74233]:   </sysinfo>
Oct 20 18:13:35 user nova-compute[74233]:   <os>
Oct 20 18:13:35 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:13:35 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:13:35 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:13:35 user nova-compute[74233]:   </os>
Oct 20 18:13:35 user nova-compute[74233]:   <features>
Oct 20 18:13:35 user nova-compute[74233]:     <acpi/>
Oct 20 18:13:35 user nova-compute[74233]:     <apic/>
Oct 20 18:13:35 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:13:35 user nova-compute[74233]:   </features>
Oct 20 18:13:35 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:13:35 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:13:35 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:13:35 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:13:35 user nova-compute[74233]:   </clock>
Oct 20 18:13:35 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:13:35 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:13:35 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:13:35 user nova-compute[74233]:   </cpu>
Oct 20 18:13:35 user nova-compute[74233]:   <devices>
Oct 20 18:13:35 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:13:35 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:13:35 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:13:35 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:13:35 user nova-compute[74233]:       <serial>03601032-c5fc-4181-95bb-e1e278d2839d</serial>
Oct 20 18:13:35 user nova-compute[74233]:     </disk>
Oct 20 18:13:35 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:13:35 user nova-compute[74233]:       <mac address="fa:16:3e:88:32:5a"/>
Oct 20 18:13:35 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:13:35 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:13:35 user nova-compute[74233]:       <target dev="tapd361737e-81"/>
Oct 20 18:13:35 user nova-compute[74233]:     </interface>
Oct 20 18:13:35 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:13:35 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/dbb80f53-2ced-431d-9315-c911c6b72f4c/console.log" append="off"/>
Oct 20 18:13:35 user nova-compute[74233]:     </serial>
Oct 20 18:13:35 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:13:35 user nova-compute[74233]:     <video>
Oct 20 18:13:35 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:13:35 user nova-compute[74233]:     </video>
Oct 20 18:13:35 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:13:35 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:13:35 user nova-compute[74233]:     </rng>
Oct 20 18:13:35 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:13:35 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:13:35 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:13:35 user nova-compute[74233]:     </memballoon>
Oct 20 18:13:35 user nova-compute[74233]:   </devices>
Oct 20 18:13:35 user nova-compute[74233]: </domain>
Oct 20 18:13:35 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-155631481',display_name='tempest-TestVolumeBootPattern-volume-backed-server-155631481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-155631481',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVmr2OcM4FDbAFDFJteCMtYaJoRuZTDzcZOs4FASKSmDJCL6u/lq356Vec0P0GBcmqFYdwvLosHY5HyeBOamEKUfvc8TuRduqZa6Y9XOUBLD8WoGfghrMn4w1FmwdEC6Q==',key_name='tempest-keypair-635002540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-l4tg6399',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=dbb80f53-2ced-431d-9315-c911c6b72f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG os_vif [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '287d74ae-a036-5bb0-b96d-119cbcadaf58', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd361737e-81, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd361737e-81, col_values=(('qos', UUID('ca0b53e1-4643-402c-b16a-41bbf649013a')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd361737e-81, col_values=(('external_ids', {'iface-id': 'd361737e-8157-4051-9970-4ac903ac279b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:32:5a', 'vm-uuid': 'dbb80f53-2ced-431d-9315-c911c6b72f4c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:35 user nova-compute[74233]: INFO os_vif [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81')
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:13:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No VIF found with MAC fa:16:3e:88:32:5a, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-08ebea3a-b87e-450d-b6cf-9dd4a6491522 req-3b92b261-398d-4bad-9452-2a47c0d5f391 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08ebea3a-b87e-450d-b6cf-9dd4a6491522 req-3b92b261-398d-4bad-9452-2a47c0d5f391 service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08ebea3a-b87e-450d-b6cf-9dd4a6491522 req-3b92b261-398d-4bad-9452-2a47c0d5f391 service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-08ebea3a-b87e-450d-b6cf-9dd4a6491522 req-3b92b261-398d-4bad-9452-2a47c0d5f391 service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-08ebea3a-b87e-450d-b6cf-9dd4a6491522 req-3b92b261-398d-4bad-9452-2a47c0d5f391 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:37 user nova-compute[74233]: WARNING nova.compute.manager [req-08ebea3a-b87e-450d-b6cf-9dd4a6491522 req-3b92b261-398d-4bad-9452-2a47c0d5f391 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received unexpected event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b for instance with vm_state building and task_state spawning.
Oct 20 18:13:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-6b0fc4d7-29c9-49f6-a035-ab58407f643d req-3f2ff95a-d9ba-4a9c-8741-990aa898c552 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b0fc4d7-29c9-49f6-a035-ab58407f643d req-3f2ff95a-d9ba-4a9c-8741-990aa898c552 service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b0fc4d7-29c9-49f6-a035-ab58407f643d req-3f2ff95a-d9ba-4a9c-8741-990aa898c552 service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b0fc4d7-29c9-49f6-a035-ab58407f643d req-3f2ff95a-d9ba-4a9c-8741-990aa898c552 service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-6b0fc4d7-29c9-49f6-a035-ab58407f643d req-3f2ff95a-d9ba-4a9c-8741-990aa898c552 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:13:39 user nova-compute[74233]: WARNING nova.compute.manager [req-6b0fc4d7-29c9-49f6-a035-ab58407f643d req-3f2ff95a-d9ba-4a9c-8741-990aa898c552 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received unexpected event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b for instance with vm_state building and task_state spawning.
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:13:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Instance spawned successfully.
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:13:39 user nova-compute[74233]: INFO nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 20 18:13:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:13:39 user nova-compute[74233]: INFO nova.compute.manager [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Took 39.85 seconds to build instance.
Oct 20 18:13:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-580a25ee-0aaa-46e4-a2ef-fd8fc319ca6d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.992s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:53 user nova-compute[74233]: INFO nova.virt.block_device [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Booting with volume 199c2bcc-8524-4202-a329-09d0ad3c1148 at /dev/vdc
Oct 20 18:13:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f22522-940b-4f80-997e-746612a99d77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d58c842-e7eb-4a6c-9f93-dea3adaecdfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[90403290-1789-49a7-9c94-c8944edf620f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da0786-ab22-4223-8bf6-569c44fe3a48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:13:54 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:13:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc10003-a78f-439d-87bd-55f6edd97b45]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG os_brick.utils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating existing volume attachment record: dfb97cf7-f22e-49fc-9816-ca69d6df6b8f {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:13:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-changed-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Refreshing instance network info cache due to event network-changed-6424d183-3ff0-49be-b22f-8515a0dbf3df. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] Acquiring lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] Acquired lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Refreshing network info cache for port 6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updated VIF entry in instance network info cache for port 6424d183-3ff0-49be-b22f-8515a0dbf3df. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating instance_info_cache with network_info: [{"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2a0608b7-e646-47ac-9985-49d70ee69f06 req-369e3469-7221-4c88-84f5-7c47f9bd42b9 service nova] Releasing lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:13:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=25.337810516357422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 38f3b094-18c4-492a-bb68-fc687012e0ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 947602c4-d7be-446e-87bc-b0137ac37f36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dbb80f53-2ced-431d-9315-c911c6b72f4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e0124740-defc-4aff-9a68-9c3604f1d3c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:14:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:04 user nova-compute[74233]: INFO nova.compute.manager [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attaching volume 7a07d1b2-ce0c-412a-95c1-dda74d52945f to /dev/vdb
Oct 20 18:14:04 user nova-compute[74233]: DEBUG os_brick.utils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[453682a4-487e-4c1c-9ffd-397bf7a947ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd638f9-9701-4cc8-ae18-d1fff4624549]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c45c83-8c9b-412c-92d1-c97933cc1275]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdee686-5bce-4d6d-b49c-b5f77bbec6c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:14:04 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:14:04 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ecf83-0614-4beb-a06d-1358fe49c2d8]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG os_brick.utils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating existing volume attachment record: e536bbfe-3c05-4541-97d1-037ff02b0373 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:14:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:15 user nova-compute[74233]: INFO nova.compute.manager [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Terminating instance
Oct 20 18:14:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-6e008182-203e-4ce2-a627-5790511b084e req-7a35ce67-41c4-4e4d-b910-f9297a7e0060 service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-vif-unplugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6e008182-203e-4ce2-a627-5790511b084e req-7a35ce67-41c4-4e4d-b910-f9297a7e0060 service nova] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6e008182-203e-4ce2-a627-5790511b084e req-7a35ce67-41c4-4e4d-b910-f9297a7e0060 service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6e008182-203e-4ce2-a627-5790511b084e req-7a35ce67-41c4-4e4d-b910-f9297a7e0060 service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-6e008182-203e-4ce2-a627-5790511b084e req-7a35ce67-41c4-4e4d-b910-f9297a7e0060 service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] No waiting events found dispatching network-vif-unplugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-6e008182-203e-4ce2-a627-5790511b084e req-7a35ce67-41c4-4e4d-b910-f9297a7e0060 service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-vif-unplugged-5745e3db-96fa-45ce-af18-162b321702cd for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:14:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Instance destroyed successfully.
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lazy-loading 'resources' on Instance uuid 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-9204685',display_name='tempest-ServersNegativeTestJSON-server-9204685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-9204685',id=15,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d20ec6bba044fb8aff5094ac65ac52',ramdisk_id='',reservation_id='r-n7dyvad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-627903216',owner_user_name='tempest-ServersNegativeTestJSON-627903216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:12:33Z,user_data=None,user_id='02bbe839e32f41268676839457c3abbd',uuid=9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converting VIF {"id": "5745e3db-96fa-45ce-af18-162b321702cd", "address": "fa:16:3e:4f:fb:98", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5745e3db-96", "ovs_interfaceid": "5745e3db-96fa-45ce-af18-162b321702cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG os_vif [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5745e3db-96, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e301b42-b362-439e-9558-8f23d7ab1f1a) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:16 user nova-compute[74233]: INFO os_vif [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:fb:98,bridge_name='br-int',has_traffic_filtering=True,id=5745e3db-96fa-45ce-af18-162b321702cd,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5745e3db-96')
Oct 20 18:14:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Deleting instance files /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf_del
Oct 20 18:14:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Deletion of /opt/stack/data/nova/instances/9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf_del complete
Oct 20 18:14:16 user nova-compute[74233]: INFO nova.compute.manager [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 18:14:16 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:14:16 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:14:17 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:17 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Took 0.81 seconds to deallocate network for instance.
Oct 20 18:14:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:17 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:17 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:17 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Deleted allocations for instance 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf
Oct 20 18:14:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a0ffe2c-bdea-454a-8f9f-89ce636e6623 tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] Acquiring lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] Lock "9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] No waiting events found dispatching network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:18 user nova-compute[74233]: WARNING nova.compute.manager [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received unexpected event network-vif-plugged-5745e3db-96fa-45ce-af18-162b321702cd for instance with vm_state deleted and task_state None.
Oct 20 18:14:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-14a0018c-7abe-465c-84cb-9d6089ecfa15 req-22fc7e3c-21fa-49d4-a74b-1953aef5c3cc service nova] [instance: 9e7d0662-e0bb-42bf-89f2-a79a0e1ed3bf] Received event network-vif-deleted-5745e3db-96fa-45ce-af18-162b321702cd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRzDoPEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:25 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:25 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:25 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aad0b0-1435-435c-9240-65ec2c794f5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:14:25 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08dae3-2ad5-46c6-bf3d-14557007a62c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f] added
Oct 20 18:14:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.104s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44eed9-a7cd-4682-8a6b-3aa5ccdbe7c4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca22a3-d5c1-4782-b334-b8e50c05a62b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRzDoPEi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRzDoPEi" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30314bd3-b8a9-460e-9a87-7c3c02f551f3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cRzDoPEi'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c9ccbb-3de1-4bf7-b690-eff566083b11]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ae938-e7cd-413f-b741-07d2b32ca356]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:26 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:26 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afddb38a-1b95-4072-a336-e3164cc59f08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260]
Oct 20 18:14:26 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260] successful.
Oct 20 18:14:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[043aad85-f425-483e-a477-e4d2ccea89ba]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ac93f-63f8-4e11-a805-584783af932d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:26 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:26 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:26 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:26 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002dcdd-40b2-452d-9e07-55233723b3d6]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRzDoPEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:14:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23438386535366534', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438386535366534', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:14:27 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:14:27 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:14:27 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:14:27 user nova-compute[74233]:   <serial>7a07d1b2-ce0c-412a-95c1-dda74d52945f</serial>
Oct 20 18:14:27 user nova-compute[74233]: </disk>
Oct 20 18:14:27 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:14:27 user nova-compute[74233]: INFO nova.compute.claims [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Claim successful on node user
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No VIF found with MAC fa:16:3e:a2:57:02, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4229cec7-3808-46fc-95f2-266d7454c8fa tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.322s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:14:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.policy [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50fe59facf744cf5b860e3b60995c05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d191f70cfa47cfbf249e5a33695689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:14:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Creating image(s)
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "d4aaec4f0ba6f64daf12f127eadbacc39d6646b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "d4aaec4f0ba6f64daf12f127eadbacc39d6646b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG nova.virt.images [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] 78a60768-e10c-41c2-a821-2dea067b1501 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.part /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Successfully created port: b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.part /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.converted" returned: 0 in 0.517s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "d4aaec4f0ba6f64daf12f127eadbacc39d6646b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.643s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Successfully updated port: b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-changed-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing instance network info cache due to event network-changed-b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "d4aaec4f0ba6f64daf12f127eadbacc39d6646b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "d4aaec4f0ba6f64daf12f127eadbacc39d6646b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2,backing_fmt=raw /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2,backing_fmt=raw /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk 1073741824" returned: 0 in 0.057s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "d4aaec4f0ba6f64daf12f127eadbacc39d6646b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance network_info: |[{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing network info cache for port b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Cannot resize image /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Ensure instance console log exists: /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Start _get_guest_xml network_info=[{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:14:24Z,direct_url=<?>,disk_format='qcow2',id=78a60768-e10c-41c2-a821-2dea067b1501,min_disk=0,min_ram=0,name='tempest-scenario-img--158289141',owner='48d191f70cfa47cfbf249e5a33695689',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:14:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '78a60768-e10c-41c2-a821-2dea067b1501'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:14:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:14:24Z,direct_url=<?>,disk_format='qcow2',id=78a60768-e10c-41c2-a821-2dea067b1501,min_disk=0,min_ram=0,name='tempest-scenario-img--158289141',owner='48d191f70cfa47cfbf249e5a33695689',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:14:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:14:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1391362163',display_name='tempest-TestMinimumBasicScenario-server-1391362163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1391362163',id=19,image_ref='78a60768-e10c-41c2-a821-2dea067b1501',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTkMoRSQXY+jyqTWauF0wzef2Z+CWqAlh3BrEaFOkDDuAiMmOfOzBHfpez7VQwr7bsIxrYYA6Taq3GGVDAFJfy2aNRwzVvqB+piX+GPwaWljU80xinC68nnlHoyShT5uA==',key_name='tempest-TestMinimumBasicScenario-393850783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-lqnau87h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='78a60768-e10c-41c2-a821-2dea067b1501',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:28Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=69779d06-b30a-4986-a7ee-b7d365236f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'pci_devices' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:14:31 user nova-compute[74233]:   <uuid>69779d06-b30a-4986-a7ee-b7d365236f77</uuid>
Oct 20 18:14:31 user nova-compute[74233]:   <name>instance-00000013</name>
Oct 20 18:14:31 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:14:31 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:14:31 user nova-compute[74233]:   <metadata>
Oct 20 18:14:31 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:14:31 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:14:31 user nova-compute[74233]:       <nova:name>tempest-TestMinimumBasicScenario-server-1391362163</nova:name>
Oct 20 18:14:31 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:14:30</nova:creationTime>
Oct 20 18:14:31 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:14:31 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:14:31 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:14:31 user nova-compute[74233]:       <nova:owner>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:user uuid="50fe59facf744cf5b860e3b60995c05a">tempest-TestMinimumBasicScenario-1650546036-project-member</nova:user>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:project uuid="48d191f70cfa47cfbf249e5a33695689">tempest-TestMinimumBasicScenario-1650546036</nova:project>
Oct 20 18:14:31 user nova-compute[74233]:       </nova:owner>
Oct 20 18:14:31 user nova-compute[74233]:       <nova:root type="image" uuid="78a60768-e10c-41c2-a821-2dea067b1501"/>
Oct 20 18:14:31 user nova-compute[74233]:       <nova:ports>
Oct 20 18:14:31 user nova-compute[74233]:         <nova:port uuid="b2da9146-db38-4031-b048-53c42d4fe002">
Oct 20 18:14:31 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 18:14:31 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:31 user nova-compute[74233]:       </nova:ports>
Oct 20 18:14:31 user nova-compute[74233]:     </nova:instance>
Oct 20 18:14:31 user nova-compute[74233]:   </metadata>
Oct 20 18:14:31 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:14:31 user nova-compute[74233]:     <system>
Oct 20 18:14:31 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:14:31 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:14:31 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:14:31 user nova-compute[74233]:       <entry name="serial">69779d06-b30a-4986-a7ee-b7d365236f77</entry>
Oct 20 18:14:31 user nova-compute[74233]:       <entry name="uuid">69779d06-b30a-4986-a7ee-b7d365236f77</entry>
Oct 20 18:14:31 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:14:31 user nova-compute[74233]:     </system>
Oct 20 18:14:31 user nova-compute[74233]:   </sysinfo>
Oct 20 18:14:31 user nova-compute[74233]:   <os>
Oct 20 18:14:31 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:14:31 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:14:31 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:14:31 user nova-compute[74233]:   </os>
Oct 20 18:14:31 user nova-compute[74233]:   <features>
Oct 20 18:14:31 user nova-compute[74233]:     <acpi/>
Oct 20 18:14:31 user nova-compute[74233]:     <apic/>
Oct 20 18:14:31 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:14:31 user nova-compute[74233]:   </features>
Oct 20 18:14:31 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:14:31 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:14:31 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:14:31 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:14:31 user nova-compute[74233]:   </clock>
Oct 20 18:14:31 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:14:31 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:14:31 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:14:31 user nova-compute[74233]:   </cpu>
Oct 20 18:14:31 user nova-compute[74233]:   <devices>
Oct 20 18:14:31 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:14:31 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:14:31 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk"/>
Oct 20 18:14:31 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:14:31 user nova-compute[74233]:     </disk>
Oct 20 18:14:31 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:31 user nova-compute[74233]:       <mac address="fa:16:3e:d2:f5:f0"/>
Oct 20 18:14:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:31 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:31 user nova-compute[74233]:       <target dev="tapb2da9146-db"/>
Oct 20 18:14:31 user nova-compute[74233]:     </interface>
Oct 20 18:14:31 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:14:31 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/console.log" append="off"/>
Oct 20 18:14:31 user nova-compute[74233]:     </serial>
Oct 20 18:14:31 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:14:31 user nova-compute[74233]:     <video>
Oct 20 18:14:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:31 user nova-compute[74233]:     </video>
Oct 20 18:14:31 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:14:31 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:14:31 user nova-compute[74233]:     </rng>
Oct 20 18:14:31 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:14:31 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:14:31 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:14:31 user nova-compute[74233]:     </memballoon>
Oct 20 18:14:31 user nova-compute[74233]:   </devices>
Oct 20 18:14:31 user nova-compute[74233]: </domain>
Oct 20 18:14:31 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1391362163',display_name='tempest-TestMinimumBasicScenario-server-1391362163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1391362163',id=19,image_ref='78a60768-e10c-41c2-a821-2dea067b1501',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTkMoRSQXY+jyqTWauF0wzef2Z+CWqAlh3BrEaFOkDDuAiMmOfOzBHfpez7VQwr7bsIxrYYA6Taq3GGVDAFJfy2aNRwzVvqB+piX+GPwaWljU80xinC68nnlHoyShT5uA==',key_name='tempest-TestMinimumBasicScenario-393850783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-lqnau87h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='78a60768-e10c-41c2-a821-2dea067b1501',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:28Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=69779d06-b30a-4986-a7ee-b7d365236f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG os_vif [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faae4cab-a756-5732-aea0-68f16ad77333', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.network.neutron [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updated VIF entry in instance network info cache for port b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.network.neutron [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2da9146-db, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2da9146-db, col_values=(('qos', UUID('e4df33b1-e93e-42f2-9d33-12fddb8ec800')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2da9146-db, col_values=(('external_ids', {'iface-id': 'b2da9146-db38-4031-b048-53c42d4fe002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:f5:f0', 'vm-uuid': '69779d06-b30a-4986-a7ee-b7d365236f77'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: INFO os_vif [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db')
Oct 20 18:14:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a1a17833-a4db-4aad-ac87-f4691d91b844 req-245a78c8-6280-4686-aaf8-b752b9db342b service nova] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No VIF found with MAC fa:16:3e:d2:f5:f0, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:14:31 user nova-compute[74233]: INFO nova.compute.claims [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Claim successful on node user
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.network.neutron [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:14:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:14:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Creating image(s)
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG nova.policy [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5149d5d6d1f486c87a0c808597a40f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c937ee3474848de8b761d88e32f6447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.269s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk 1073741824" returned: 0 in 0.067s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9182dea-60e4-4846-9b01-e62de5613bf2 req-673f49c1-f1bd-44ff-8284-7d46af3a8fab service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9182dea-60e4-4846-9b01-e62de5613bf2 req-673f49c1-f1bd-44ff-8284-7d46af3a8fab service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9182dea-60e4-4846-9b01-e62de5613bf2 req-673f49c1-f1bd-44ff-8284-7d46af3a8fab service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9182dea-60e4-4846-9b01-e62de5613bf2 req-673f49c1-f1bd-44ff-8284-7d46af3a8fab service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9182dea-60e4-4846-9b01-e62de5613bf2 req-673f49c1-f1bd-44ff-8284-7d46af3a8fab service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:33 user nova-compute[74233]: WARNING nova.compute.manager [req-f9182dea-60e4-4846-9b01-e62de5613bf2 req-673f49c1-f1bd-44ff-8284-7d46af3a8fab service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state building and task_state spawning.
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Cannot resize image /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Ensure instance console log exists: /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:34 user nova-compute[74233]: DEBUG nova.network.neutron [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Successfully created port: 2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:14:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance spawned successfully.
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Successfully updated port: 2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-a782bce6-338f-4373-b9c1-22ab35f2c293 req-98aeb5d9-f12d-4a1f-90dc-5d4c52d05f78 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a782bce6-338f-4373-b9c1-22ab35f2c293 req-98aeb5d9-f12d-4a1f-90dc-5d4c52d05f78 service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a782bce6-338f-4373-b9c1-22ab35f2c293 req-98aeb5d9-f12d-4a1f-90dc-5d4c52d05f78 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a782bce6-338f-4373-b9c1-22ab35f2c293 req-98aeb5d9-f12d-4a1f-90dc-5d4c52d05f78 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-a782bce6-338f-4373-b9c1-22ab35f2c293 req-98aeb5d9-f12d-4a1f-90dc-5d4c52d05f78 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:35 user nova-compute[74233]: WARNING nova.compute.manager [req-a782bce6-338f-4373-b9c1-22ab35f2c293 req-98aeb5d9-f12d-4a1f-90dc-5d4c52d05f78 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state building and task_state spawning.
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:14:35 user nova-compute[74233]: INFO nova.compute.claims [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Claim successful on node user
Oct 20 18:14:35 user nova-compute[74233]: INFO nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Took 7.04 seconds to spawn the instance on the hypervisor.
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.objects.instance [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:35 user nova-compute[74233]: INFO nova.compute.manager [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Took 7.94 seconds to build instance.
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4cef3ed7-b8f5-436d-98c1-2d875580958f tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.049s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Updating instance_info_cache with network_info: [{"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Instance network_info: |[{"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Start _get_guest_xml network_info=[{"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:14:35 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:35 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:35 user nova-compute[74233]: INFO nova.compute.manager [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attaching volume b85230a7-deba-467a-815c-122e9b74d38f to /dev/vdc
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1672533967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1672533967',id=20,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-cxzzw17q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:32Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=7bdc323f-b8a2-4924-86bf-b35b1d680027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.objects.instance [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bdc323f-b8a2-4924-86bf-b35b1d680027 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:14:35 user nova-compute[74233]:   <uuid>7bdc323f-b8a2-4924-86bf-b35b1d680027</uuid>
Oct 20 18:14:35 user nova-compute[74233]:   <name>instance-00000014</name>
Oct 20 18:14:35 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:14:35 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:14:35 user nova-compute[74233]:   <metadata>
Oct 20 18:14:35 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:14:35 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:14:35 user nova-compute[74233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1672533967</nova:name>
Oct 20 18:14:35 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:14:35</nova:creationTime>
Oct 20 18:14:35 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:14:35 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:14:35 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:14:35 user nova-compute[74233]:       <nova:owner>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:user uuid="a5149d5d6d1f486c87a0c808597a40f3">tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member</nova:user>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:project uuid="8c937ee3474848de8b761d88e32f6447">tempest-ServerBootFromVolumeStableRescueTest-481267461</nova:project>
Oct 20 18:14:35 user nova-compute[74233]:       </nova:owner>
Oct 20 18:14:35 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:14:35 user nova-compute[74233]:       <nova:ports>
Oct 20 18:14:35 user nova-compute[74233]:         <nova:port uuid="2b22dfe5-9a38-48a2-9436-59a232ee3bad">
Oct 20 18:14:35 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:14:35 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:35 user nova-compute[74233]:       </nova:ports>
Oct 20 18:14:35 user nova-compute[74233]:     </nova:instance>
Oct 20 18:14:35 user nova-compute[74233]:   </metadata>
Oct 20 18:14:35 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:14:35 user nova-compute[74233]:     <system>
Oct 20 18:14:35 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:14:35 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:14:35 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:14:35 user nova-compute[74233]:       <entry name="serial">7bdc323f-b8a2-4924-86bf-b35b1d680027</entry>
Oct 20 18:14:35 user nova-compute[74233]:       <entry name="uuid">7bdc323f-b8a2-4924-86bf-b35b1d680027</entry>
Oct 20 18:14:35 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:14:35 user nova-compute[74233]:     </system>
Oct 20 18:14:35 user nova-compute[74233]:   </sysinfo>
Oct 20 18:14:35 user nova-compute[74233]:   <os>
Oct 20 18:14:35 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:14:35 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:14:35 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:14:35 user nova-compute[74233]:   </os>
Oct 20 18:14:35 user nova-compute[74233]:   <features>
Oct 20 18:14:35 user nova-compute[74233]:     <acpi/>
Oct 20 18:14:35 user nova-compute[74233]:     <apic/>
Oct 20 18:14:35 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:14:35 user nova-compute[74233]:   </features>
Oct 20 18:14:35 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:14:35 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:14:35 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:14:35 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:14:35 user nova-compute[74233]:   </clock>
Oct 20 18:14:35 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:14:35 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:14:35 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:14:35 user nova-compute[74233]:   </cpu>
Oct 20 18:14:35 user nova-compute[74233]:   <devices>
Oct 20 18:14:35 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:14:35 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:14:35 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk"/>
Oct 20 18:14:35 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:14:35 user nova-compute[74233]:     </disk>
Oct 20 18:14:35 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:35 user nova-compute[74233]:       <mac address="fa:16:3e:87:d1:3b"/>
Oct 20 18:14:35 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:35 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:35 user nova-compute[74233]:       <target dev="tap2b22dfe5-9a"/>
Oct 20 18:14:35 user nova-compute[74233]:     </interface>
Oct 20 18:14:35 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:14:35 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/console.log" append="off"/>
Oct 20 18:14:35 user nova-compute[74233]:     </serial>
Oct 20 18:14:35 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:14:35 user nova-compute[74233]:     <video>
Oct 20 18:14:35 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:35 user nova-compute[74233]:     </video>
Oct 20 18:14:35 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:14:35 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:14:35 user nova-compute[74233]:     </rng>
Oct 20 18:14:35 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:14:35 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:14:35 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:14:35 user nova-compute[74233]:     </memballoon>
Oct 20 18:14:35 user nova-compute[74233]:   </devices>
Oct 20 18:14:35 user nova-compute[74233]: </domain>
Oct 20 18:14:35 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1672533967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1672533967',id=20,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-cxzzw17q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:32Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=7bdc323f-b8a2-4924-86bf-b35b1d680027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG os_vif [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3e7d87f-f8ed-5893-a6eb-d58364e76af5', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b22dfe5-9a, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b22dfe5-9a, col_values=(('qos', UUID('ac22e954-b8a5-4132-b7df-98e239c1278d')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b22dfe5-9a, col_values=(('external_ids', {'iface-id': '2b22dfe5-9a38-48a2-9436-59a232ee3bad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:d1:3b', 'vm-uuid': '7bdc323f-b8a2-4924-86bf-b35b1d680027'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:35 user nova-compute[74233]: INFO os_vif [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a')
Oct 20 18:14:35 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG os_brick.utils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503dffd-86c7-40a6-9296-3b00d4e671d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[574482ab-6fc0-4ea1-9ff4-bfb50fc2f092]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No VIF found with MAC fa:16:3e:87:d1:3b, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[229bec35-4674-4675-a852-304bd9c881b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4a865d-d58d-43b7-819e-2a6931fb5707]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:14:36 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f109d-d4cf-4fd9-a17d-04af192f1ae8]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG os_brick.utils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating existing volume attachment record: 8f34ca9b-70e8-463e-a88d-2499d6ee2829 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:14:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.policy [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15b21695cdfe4b4299fb08403ed15ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e847f3ff044181bb615138361ec8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:14:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Creating image(s)
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:14:36 user nova-compute[74233]: INFO nova.compute.claims [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Claim successful on node user
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.225s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.242s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk 1073741824" returned: 0 in 0.078s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Successfully created port: fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.228s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Cannot resize image /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Ensure instance console log exists: /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-changed-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Refreshing instance network info cache due to event network-changed-2b22dfe5-9a38-48a2-9436-59a232ee3bad. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] Acquiring lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] Acquired lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Refreshing network info cache for port 2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.078s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:14:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.policy [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15b21695cdfe4b4299fb08403ed15ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e847f3ff044181bb615138361ec8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:14:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Creating image(s)
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:14:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Creating image(s)
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Ensure instance console log exists: /opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Start _get_guest_xml network_info=[{"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '3c46517c-9f8a-4f80-b394-29f072613c52', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZVeynXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '947602c4-d7be-446e-87bc-b0137ac37f36', 'attached_at': '', 'detached_at': '', 'volume_id': '40148486-b5b3-489d-934c-21f389d51176', 'serial': '40148486-b5b3-489d-934c-21f389d51176'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '075c6bda-8410-4d94-84ee-04cd4aa3da7d', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saPWuRTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '947602c4-d7be-446e-87bc-b0137ac37f36', 'attached_at': '', 'detached_at': '', 'volume_id': 'e328c698-0f86-40c4-b403-c7e1c965d20d', 'serial': 'e328c698-0f86-40c4-b403-c7e1c965d20d'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'dfb97cf7-f22e-49fc-9816-ca69d6df6b8f', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovrKGXSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '947602c4-d7be-446e-87bc-b0137ac37f36', 'attached_at': '', 'detached_at': '', 'volume_id': '199c2bcc-8524-4202-a329-09d0ad3c1148', 'serial': '199c2bcc-8524-4202-a329-09d0ad3c1148'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Updated VIF entry in instance network info cache for port 2b22dfe5-9a38-48a2-9436-59a232ee3bad. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Updating instance_info_cache with network_info: [{"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Successfully updated port: fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-bbe484ba-f020-46e9-b122-e7be3354d38c req-fa2e94b3-95aa-43bd-b985-2f3eb2c70fe7 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bbe484ba-f020-46e9-b122-e7be3354d38c req-fa2e94b3-95aa-43bd-b985-2f3eb2c70fe7 service nova] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bbe484ba-f020-46e9-b122-e7be3354d38c req-fa2e94b3-95aa-43bd-b985-2f3eb2c70fe7 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bbe484ba-f020-46e9-b122-e7be3354d38c req-fa2e94b3-95aa-43bd-b985-2f3eb2c70fe7 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-bbe484ba-f020-46e9-b122-e7be3354d38c req-fa2e94b3-95aa-43bd-b985-2f3eb2c70fe7 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] No waiting events found dispatching network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:38 user nova-compute[74233]: WARNING nova.compute.manager [req-bbe484ba-f020-46e9-b122-e7be3354d38c req-fa2e94b3-95aa-43bd-b985-2f3eb2c70fe7 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received unexpected event network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad for instance with vm_state building and task_state spawning.
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.585s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b6dd347e-e01d-40c6-b230-fdbd1b2d669c req-4ac046db-c91a-491e-914b-d301deb7829f service nova] Releasing lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:14:38 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:38 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZVeynXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:38 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:38 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:38 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8443a2c3-b871-413d-b88f-66f5a3f12a24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:14:38 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d4987-9ab0-49cc-a48c-8c612aa94f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176] added
Oct 20 18:14:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacc5bef-3a8a-4afc-8276-17872d01f1a4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7bd98-d3ea-4559-9542-21cc0a7399c6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZVeynXS {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.281s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZVeynXS" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e54172-b081-4aff-81d0-8c7b2865b2ad]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZVeynXS'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[72833267-5cce-4bcf-8be1-e2a1d42ed2fc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk 1073741824" returned: 0 in 0.098s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898b930-5e28-4d0e-ad45-6db1d57f6dc6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:38 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:38 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:38 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:38 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:38 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9084f5-42bb-4963-99b8-89c79ddced06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260]
Oct 20 18:14:39 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260] successful.
Oct 20 18:14:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ea049c-29cd-48e0-9570-c343c59c01fa]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5cafba-aaa6-4e87-be2b-094711c686d0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:39 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:39 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:39 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:39 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.481s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Successfully created port: 5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d6160f-c7f2-439b-969e-79b9171e81f7]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZVeynXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.304s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance network_info: |[{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Start _get_guest_xml network_info=[{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:14:39 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:39 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1201958767',display_name='tempest-ServerRescueNegativeTestJSON-server-1201958767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1201958767',id=21,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-np33292u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:36Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=dc2ea472-32aa-44bb-90e1-03062a4ec3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.objects.instance [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'pci_devices' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:14:39 user nova-compute[74233]:   <uuid>dc2ea472-32aa-44bb-90e1-03062a4ec3f4</uuid>
Oct 20 18:14:39 user nova-compute[74233]:   <name>instance-00000015</name>
Oct 20 18:14:39 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:14:39 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:14:39 user nova-compute[74233]:   <metadata>
Oct 20 18:14:39 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:14:39 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:14:39 user nova-compute[74233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1201958767</nova:name>
Oct 20 18:14:39 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:14:39</nova:creationTime>
Oct 20 18:14:39 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:14:39 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:14:39 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:14:39 user nova-compute[74233]:       <nova:owner>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:user uuid="15b21695cdfe4b4299fb08403ed15ddd">tempest-ServerRescueNegativeTestJSON-226182355-project-member</nova:user>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:project uuid="51e847f3ff044181bb615138361ec8da">tempest-ServerRescueNegativeTestJSON-226182355</nova:project>
Oct 20 18:14:39 user nova-compute[74233]:       </nova:owner>
Oct 20 18:14:39 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:14:39 user nova-compute[74233]:       <nova:ports>
Oct 20 18:14:39 user nova-compute[74233]:         <nova:port uuid="fb255a80-de0b-488a-b67a-946e1bd3dc98">
Oct 20 18:14:39 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 18:14:39 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:39 user nova-compute[74233]:       </nova:ports>
Oct 20 18:14:39 user nova-compute[74233]:     </nova:instance>
Oct 20 18:14:39 user nova-compute[74233]:   </metadata>
Oct 20 18:14:39 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:14:39 user nova-compute[74233]:     <system>
Oct 20 18:14:39 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:14:39 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:14:39 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:14:39 user nova-compute[74233]:       <entry name="serial">dc2ea472-32aa-44bb-90e1-03062a4ec3f4</entry>
Oct 20 18:14:39 user nova-compute[74233]:       <entry name="uuid">dc2ea472-32aa-44bb-90e1-03062a4ec3f4</entry>
Oct 20 18:14:39 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:14:39 user nova-compute[74233]:     </system>
Oct 20 18:14:39 user nova-compute[74233]:   </sysinfo>
Oct 20 18:14:39 user nova-compute[74233]:   <os>
Oct 20 18:14:39 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:14:39 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:14:39 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:14:39 user nova-compute[74233]:   </os>
Oct 20 18:14:39 user nova-compute[74233]:   <features>
Oct 20 18:14:39 user nova-compute[74233]:     <acpi/>
Oct 20 18:14:39 user nova-compute[74233]:     <apic/>
Oct 20 18:14:39 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:14:39 user nova-compute[74233]:   </features>
Oct 20 18:14:39 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:14:39 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:14:39 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:14:39 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:14:39 user nova-compute[74233]:   </clock>
Oct 20 18:14:39 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:14:39 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:14:39 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:14:39 user nova-compute[74233]:   </cpu>
Oct 20 18:14:39 user nova-compute[74233]:   <devices>
Oct 20 18:14:39 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:14:39 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:14:39 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk"/>
Oct 20 18:14:39 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:14:39 user nova-compute[74233]:     </disk>
Oct 20 18:14:39 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:39 user nova-compute[74233]:       <mac address="fa:16:3e:0a:67:00"/>
Oct 20 18:14:39 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:39 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:39 user nova-compute[74233]:       <target dev="tapfb255a80-de"/>
Oct 20 18:14:39 user nova-compute[74233]:     </interface>
Oct 20 18:14:39 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:14:39 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/console.log" append="off"/>
Oct 20 18:14:39 user nova-compute[74233]:     </serial>
Oct 20 18:14:39 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:14:39 user nova-compute[74233]:     <video>
Oct 20 18:14:39 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:39 user nova-compute[74233]:     </video>
Oct 20 18:14:39 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:14:39 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:14:39 user nova-compute[74233]:     </rng>
Oct 20 18:14:39 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:14:39 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:14:39 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:14:39 user nova-compute[74233]:     </memballoon>
Oct 20 18:14:39 user nova-compute[74233]:   </devices>
Oct 20 18:14:39 user nova-compute[74233]: </domain>
Oct 20 18:14:39 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1201958767',display_name='tempest-ServerRescueNegativeTestJSON-server-1201958767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1201958767',id=21,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-np33292u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:36Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=dc2ea472-32aa-44bb-90e1-03062a4ec3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG os_vif [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67a9defa-b6f6-5c2d-a96e-a75d1625a757', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb255a80-de, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb255a80-de, col_values=(('qos', UUID('d6f2aa30-b6f9-44e2-986a-b578afa3d636')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb255a80-de, col_values=(('external_ids', {'iface-id': 'fb255a80-de0b-488a-b67a-946e1bd3dc98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:67:00', 'vm-uuid': 'dc2ea472-32aa-44bb-90e1-03062a4ec3f4'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:39 user nova-compute[74233]: INFO os_vif [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de')
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-changed-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Refreshing instance network info cache due to event network-changed-fb255a80-de0b-488a-b67a-946e1bd3dc98. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Refreshing network info cache for port fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Cannot resize image /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Ensure instance console log exists: /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:0a:67:00, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updated VIF entry in instance network info cache for port fb255a80-de0b-488a-b67a-946e1bd3dc98. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bde7e35b-39a2-40b6-9215-8eb78eb5de10 req-446ada19-6953-499c-8fe2-de9b283ec12f service nova] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.549s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== connect_volume: return (1555ms) {'type': 'block', 'scsi_wwn': '26534623530666436', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534623530666436', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saPWuRTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:40 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:40 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:40 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-f6e355e9-5921-439a-9972-8e403ebb866d req-c9104a7e-7623-45e4-8448-b12c4feca235 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f6e355e9-5921-439a-9972-8e403ebb866d req-c9104a7e-7623-45e4-8448-b12c4feca235 service nova] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f6e355e9-5921-439a-9972-8e403ebb866d req-c9104a7e-7623-45e4-8448-b12c4feca235 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f6e355e9-5921-439a-9972-8e403ebb866d req-c9104a7e-7623-45e4-8448-b12c4feca235 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-f6e355e9-5921-439a-9972-8e403ebb866d req-c9104a7e-7623-45e4-8448-b12c4feca235 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] No waiting events found dispatching network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:40 user nova-compute[74233]: WARNING nova.compute.manager [req-f6e355e9-5921-439a-9972-8e403ebb866d req-c9104a7e-7623-45e4-8448-b12c4feca235 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received unexpected event network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad for instance with vm_state building and task_state spawning.
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd00d0-3108-4ec9-8010-736b107c5d58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:14:40 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f2c94a-3fe2-4349-bcb0-523666761615]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d] added
Oct 20 18:14:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[66308ab8-66cb-4c5a-956f-8663f5e7c76b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:14:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Instance spawned successfully.
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d044e59-0783-4b13-a2c2-f7e2f93f2fa3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saPWuRTi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saPWuRTi" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e041b86-44a0-4926-9e9b-2c6e2292e853]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saPWuRTi'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Successfully updated port: 5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[70600bc3-4f35-445e-b0e7-cfbd86d54f9f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb750dc-7692-4d14-96ad-ae40e5b43378]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: INFO nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Took 8.01 seconds to spawn the instance on the hypervisor.
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c62b907-6768-4678-b1fb-c53ba66d26d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260]
Oct 20 18:14:40 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260] successful.
Oct 20 18:14:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3546c17-802b-473f-86f5-bf4c1bbb4a37]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cfde6d-a7b7-4778-9a71-c6f473466a0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:14:40 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:40 user nova-compute[74233]: INFO nova.compute.manager [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Took 8.92 seconds to build instance.
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c31ed-0d3b-4125-bcf6-b8eb7869aae6]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saPWuRTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-611473cf-bf71-48bb-917a-97ccefecfb0b tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.035s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updating instance_info_cache with network_info: [{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance network_info: |[{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Start _get_guest_xml network_info=[{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:14:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:14:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1831294329',display_name='tempest-ServerRescueNegativeTestJSON-server-1831294329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1831294329',id=22,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-s8wlcmb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:38Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=f8ba938f-246b-41d5-ab0f-30a41d148f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'pci_devices' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:14:41 user nova-compute[74233]:   <uuid>f8ba938f-246b-41d5-ab0f-30a41d148f1f</uuid>
Oct 20 18:14:41 user nova-compute[74233]:   <name>instance-00000016</name>
Oct 20 18:14:41 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:14:41 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:14:41 user nova-compute[74233]:   <metadata>
Oct 20 18:14:41 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:14:41 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:14:41 user nova-compute[74233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1831294329</nova:name>
Oct 20 18:14:41 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:14:40</nova:creationTime>
Oct 20 18:14:41 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:14:41 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:14:41 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:14:41 user nova-compute[74233]:       <nova:owner>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:user uuid="15b21695cdfe4b4299fb08403ed15ddd">tempest-ServerRescueNegativeTestJSON-226182355-project-member</nova:user>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:project uuid="51e847f3ff044181bb615138361ec8da">tempest-ServerRescueNegativeTestJSON-226182355</nova:project>
Oct 20 18:14:41 user nova-compute[74233]:       </nova:owner>
Oct 20 18:14:41 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:14:41 user nova-compute[74233]:       <nova:ports>
Oct 20 18:14:41 user nova-compute[74233]:         <nova:port uuid="5ae1063f-fe60-46cb-ad70-65daa8b58493">
Oct 20 18:14:41 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:14:41 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:41 user nova-compute[74233]:       </nova:ports>
Oct 20 18:14:41 user nova-compute[74233]:     </nova:instance>
Oct 20 18:14:41 user nova-compute[74233]:   </metadata>
Oct 20 18:14:41 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:14:41 user nova-compute[74233]:     <system>
Oct 20 18:14:41 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:14:41 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:14:41 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:14:41 user nova-compute[74233]:       <entry name="serial">f8ba938f-246b-41d5-ab0f-30a41d148f1f</entry>
Oct 20 18:14:41 user nova-compute[74233]:       <entry name="uuid">f8ba938f-246b-41d5-ab0f-30a41d148f1f</entry>
Oct 20 18:14:41 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:14:41 user nova-compute[74233]:     </system>
Oct 20 18:14:41 user nova-compute[74233]:   </sysinfo>
Oct 20 18:14:41 user nova-compute[74233]:   <os>
Oct 20 18:14:41 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:14:41 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:14:41 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:14:41 user nova-compute[74233]:   </os>
Oct 20 18:14:41 user nova-compute[74233]:   <features>
Oct 20 18:14:41 user nova-compute[74233]:     <acpi/>
Oct 20 18:14:41 user nova-compute[74233]:     <apic/>
Oct 20 18:14:41 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:14:41 user nova-compute[74233]:   </features>
Oct 20 18:14:41 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:14:41 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:14:41 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:14:41 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:14:41 user nova-compute[74233]:   </clock>
Oct 20 18:14:41 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:14:41 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:14:41 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:14:41 user nova-compute[74233]:   </cpu>
Oct 20 18:14:41 user nova-compute[74233]:   <devices>
Oct 20 18:14:41 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:14:41 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:14:41 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk"/>
Oct 20 18:14:41 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:14:41 user nova-compute[74233]:     </disk>
Oct 20 18:14:41 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:41 user nova-compute[74233]:       <mac address="fa:16:3e:87:ba:a3"/>
Oct 20 18:14:41 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:41 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:41 user nova-compute[74233]:       <target dev="tap5ae1063f-fe"/>
Oct 20 18:14:41 user nova-compute[74233]:     </interface>
Oct 20 18:14:41 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:14:41 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/console.log" append="off"/>
Oct 20 18:14:41 user nova-compute[74233]:     </serial>
Oct 20 18:14:41 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:14:41 user nova-compute[74233]:     <video>
Oct 20 18:14:41 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:41 user nova-compute[74233]:     </video>
Oct 20 18:14:41 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:14:41 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:14:41 user nova-compute[74233]:     </rng>
Oct 20 18:14:41 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:14:41 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:14:41 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:14:41 user nova-compute[74233]:     </memballoon>
Oct 20 18:14:41 user nova-compute[74233]:   </devices>
Oct 20 18:14:41 user nova-compute[74233]: </domain>
Oct 20 18:14:41 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1831294329',display_name='tempest-ServerRescueNegativeTestJSON-server-1831294329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1831294329',id=22,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-s8wlcmb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:38Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=f8ba938f-246b-41d5-ab0f-30a41d148f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_vif [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b1aed0a-bcb3-5fc5-a007-3adbde4bad43', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ae1063f-fe, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ae1063f-fe, col_values=(('qos', UUID('906583f5-1848-46c5-9a16-5d36996054d1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ae1063f-fe, col_values=(('external_ids', {'iface-id': '5ae1063f-fe60-46cb-ad70-65daa8b58493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:ba:a3', 'vm-uuid': 'f8ba938f-246b-41d5-ab0f-30a41d148f1f'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: INFO os_vif [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe')
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:87:ba:a3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-d2d2d0c1-0697-45fc-8538-2ea4b88f3a3d req-58de481c-1d4d-4a67-a6b3-63976aeefc74 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d2d2d0c1-0697-45fc-8538-2ea4b88f3a3d req-58de481c-1d4d-4a67-a6b3-63976aeefc74 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d2d2d0c1-0697-45fc-8538-2ea4b88f3a3d req-58de481c-1d4d-4a67-a6b3-63976aeefc74 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d2d2d0c1-0697-45fc-8538-2ea4b88f3a3d req-58de481c-1d4d-4a67-a6b3-63976aeefc74 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-d2d2d0c1-0697-45fc-8538-2ea4b88f3a3d req-58de481c-1d4d-4a67-a6b3-63976aeefc74 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:41 user nova-compute[74233]: WARNING nova.compute.manager [req-d2d2d0c1-0697-45fc-8538-2ea4b88f3a3d req-58de481c-1d4d-4a67-a6b3-63976aeefc74 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state building and task_state spawning.
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26537643239306661', 'path': '/dev/sdf'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537643239306661', 'path': '/dev/sdf'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovrKGXSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:41 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:41 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:41 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85911fde-5ddc-4b2d-ad60-98e9b6b54ef2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:14:41 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2447e59-d3e2-4817-b92c-d964d742c24d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148] added
Oct 20 18:14:41 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f2f87-0fdc-4a69-a86a-22034ca41d27]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c817a-15c6-4788-b4ea-f30d271d2e04]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovrKGXSW {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovrKGXSW" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[572921f4-e658-449e-8947-293211885020]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovrKGXSW'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba8f7a-4a3f-45cb-b1ac-7bee6d862881]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a09391-2449-44c1-8ad9-90f1a5b1c236]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b638aef-1fc6-4875-9e11-bb24bd76fdb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260]
Oct 20 18:14:42 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260] successful.
Oct 20 18:14:42 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b08a48c-1776-4e8a-be6f-2f3f2974c660]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a61be-c54e-4bdd-aa02-577f4a3fa77e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:14:42 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac88781-0286-4122-9bb5-eed84b57c4c0]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovrKGXSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-changed-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Refreshing instance network info cache due to event network-changed-5ae1063f-fe60-46cb-ad70-65daa8b58493. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] Acquiring lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] Acquired lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG nova.network.neutron [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Refreshing network info cache for port 5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG nova.network.neutron [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updated VIF entry in instance network info cache for port 5ae1063f-fe60-46cb-ad70-65daa8b58493. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG nova.network.neutron [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updating instance_info_cache with network_info: [{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f93898a8-4f3d-4a07-bc07-9d81a640c1e6 req-b283bcbf-381e-4db9-9108-78d346493fef service nova] Releasing lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23136303562376331', 'path': '/dev/sdg'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136303562376331', 'path': '/dev/sdg'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lazy-loading 'pci_devices' on Instance uuid 947602c4-d7be-446e-87bc-b0137ac37f36 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:14:43 user nova-compute[74233]:   <uuid>947602c4-d7be-446e-87bc-b0137ac37f36</uuid>
Oct 20 18:14:43 user nova-compute[74233]:   <name>instance-00000010</name>
Oct 20 18:14:43 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:14:43 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:14:43 user nova-compute[74233]:   <metadata>
Oct 20 18:14:43 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:14:43 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:14:43 user nova-compute[74233]:       <nova:name>tempest-device-tagging-server-2011573578</nova:name>
Oct 20 18:14:43 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:14:38</nova:creationTime>
Oct 20 18:14:43 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:14:43 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:14:43 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:14:43 user nova-compute[74233]:       <nova:owner>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:user uuid="4faad54e08c645dc89cc14332c6b6838">tempest-TaggedBootDevicesTest-1557453215-project-member</nova:user>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:project uuid="1a0effbd2489472d8c0f0661b4349e69">tempest-TaggedBootDevicesTest-1557453215</nova:project>
Oct 20 18:14:43 user nova-compute[74233]:       </nova:owner>
Oct 20 18:14:43 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:14:43 user nova-compute[74233]:       <nova:ports>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="cd431c77-ddfd-406f-a2c5-fae2ce2523dd">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="ca61b8dd-439a-48ef-9be7-73c94df5d3ec">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.125" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="89a2575d-107e-4825-84d4-1dac010e112a">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="d4d5b7c5-29fc-4cd6-a355-808cf6f24765">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="4048936f-0e3b-44c2-a850-c31201c29593">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="05589e7f-2a3d-4e36-b55b-ad3f3b07184b">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:         <nova:port uuid="b7e9e9de-30cd-4372-a8c8-6ec480fc3520">
Oct 20 18:14:43 user nova-compute[74233]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 18:14:43 user nova-compute[74233]:         </nova:port>
Oct 20 18:14:43 user nova-compute[74233]:       </nova:ports>
Oct 20 18:14:43 user nova-compute[74233]:     </nova:instance>
Oct 20 18:14:43 user nova-compute[74233]:   </metadata>
Oct 20 18:14:43 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:14:43 user nova-compute[74233]:     <system>
Oct 20 18:14:43 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:14:43 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:14:43 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:14:43 user nova-compute[74233]:       <entry name="serial">947602c4-d7be-446e-87bc-b0137ac37f36</entry>
Oct 20 18:14:43 user nova-compute[74233]:       <entry name="uuid">947602c4-d7be-446e-87bc-b0137ac37f36</entry>
Oct 20 18:14:43 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:14:43 user nova-compute[74233]:     </system>
Oct 20 18:14:43 user nova-compute[74233]:   </sysinfo>
Oct 20 18:14:43 user nova-compute[74233]:   <os>
Oct 20 18:14:43 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:14:43 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:14:43 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:14:43 user nova-compute[74233]:   </os>
Oct 20 18:14:43 user nova-compute[74233]:   <features>
Oct 20 18:14:43 user nova-compute[74233]:     <acpi/>
Oct 20 18:14:43 user nova-compute[74233]:     <apic/>
Oct 20 18:14:43 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:14:43 user nova-compute[74233]:   </features>
Oct 20 18:14:43 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:14:43 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:14:43 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:14:43 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:14:43 user nova-compute[74233]:   </clock>
Oct 20 18:14:43 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:14:43 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:14:43 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:14:43 user nova-compute[74233]:   </cpu>
Oct 20 18:14:43 user nova-compute[74233]:   <devices>
Oct 20 18:14:43 user nova-compute[74233]:     <disk type="file" device="cdrom">
Oct 20 18:14:43 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 18:14:43 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36/disk.config"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="hda" bus="ide"/>
Oct 20 18:14:43 user nova-compute[74233]:     </disk>
Oct 20 18:14:43 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:14:43 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:14:43 user nova-compute[74233]:       <source dev="/dev/sde"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <serial>40148486-b5b3-489d-934c-21f389d51176</serial>
Oct 20 18:14:43 user nova-compute[74233]:     </disk>
Oct 20 18:14:43 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:14:43 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:14:43 user nova-compute[74233]:       <source dev="/dev/sdf"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <serial>e328c698-0f86-40c4-b403-c7e1c965d20d</serial>
Oct 20 18:14:43 user nova-compute[74233]:     </disk>
Oct 20 18:14:43 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:14:43 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:14:43 user nova-compute[74233]:       <source dev="/dev/sdg"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="vdc" bus="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <serial>199c2bcc-8524-4202-a329-09d0ad3c1148</serial>
Oct 20 18:14:43 user nova-compute[74233]:     </disk>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:57:6d:60"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tapcd431c77-dd"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:b1:ee:2e"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tapca61b8dd-43"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:08:8d:16"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tap89a2575d-10"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:51:9a:fc"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tapd4d5b7c5-29"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:12:57:ca"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tap4048936f-0e"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:d8:28:5e"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tap05589e7f-2a"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:14:43 user nova-compute[74233]:       <mac address="fa:16:3e:00:75:07"/>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:14:43 user nova-compute[74233]:       <target dev="tapb7e9e9de-30"/>
Oct 20 18:14:43 user nova-compute[74233]:     </interface>
Oct 20 18:14:43 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:14:43 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36/console.log" append="off"/>
Oct 20 18:14:43 user nova-compute[74233]:     </serial>
Oct 20 18:14:43 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:14:43 user nova-compute[74233]:     <video>
Oct 20 18:14:43 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:14:43 user nova-compute[74233]:     </video>
Oct 20 18:14:43 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:14:43 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:14:43 user nova-compute[74233]:     </rng>
Oct 20 18:14:43 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:14:43 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:14:43 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:14:43 user nova-compute[74233]:     </memballoon>
Oct 20 18:14:43 user nova-compute[74233]:   </devices>
Oct 20 18:14:43 user nova-compute[74233]: </domain>
Oct 20 18:14:43 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd75eec96-76c8-59a3-937d-f66e071128e4', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd431c77-dd, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd431c77-dd, col_values=(('qos', UUID('3d86c06f-bc21-43ee-9a4e-b49ff4e9ab6f')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd431c77-dd, col_values=(('external_ids', {'iface-id': 'cd431c77-ddfd-406f-a2c5-fae2ce2523dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:6d:60', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd')
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e950c3a4-13ea-5367-bd9e-45bc34a8d2f6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca61b8dd-43, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca61b8dd-43, col_values=(('qos', UUID('b0efd909-21cb-410d-8f4b-74af303cdd12')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca61b8dd-43, col_values=(('external_ids', {'iface-id': 'ca61b8dd-439a-48ef-9be7-73c94df5d3ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:ee:2e', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43')
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36e72b6d-917b-517c-bec1-0f2b82376494', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89a2575d-10, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89a2575d-10, col_values=(('qos', UUID('df14d824-7261-41f7-9abe-642b1c04a251')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89a2575d-10, col_values=(('external_ids', {'iface-id': '89a2575d-107e-4825-84d4-1dac010e112a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:8d:16', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10')
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad9641d0-78fd-5303-859c-16bce1f3d3d7', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d5b7c5-29, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4d5b7c5-29, col_values=(('qos', UUID('a22b2bcc-7f9c-4666-9602-1d5eb4fb2b0c')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4d5b7c5-29, col_values=(('external_ids', {'iface-id': 'd4d5b7c5-29fc-4cd6-a355-808cf6f24765', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:9a:fc', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:43 user nova-compute[74233]: WARNING nova.compute.manager [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state building and task_state spawning.
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:43 user nova-compute[74233]: WARNING nova.compute.manager [req-aa1c0d14-40a2-4412-9651-c7e0f09a4181 req-7909da42-d6db-461d-b4f7-0456ff27aac6 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state building and task_state spawning.
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29')
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd43c5477-b050-596e-97c4-929c5424bcaa', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4048936f-0e, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4048936f-0e, col_values=(('qos', UUID('09e93e60-c5ba-4a6b-972a-d01d656895d1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4048936f-0e, col_values=(('external_ids', {'iface-id': '4048936f-0e3b-44c2-a850-c31201c29593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:57:ca', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e')
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de4c544f-8c52-56d2-adcc-337d62b4bc2e', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05589e7f-2a, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05589e7f-2a, col_values=(('qos', UUID('a27c228f-0a70-4478-9ab1-cd85105f7b4b')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05589e7f-2a, col_values=(('external_ids', {'iface-id': '05589e7f-2a3d-4e36-b55b-ad3f3b07184b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:28:5e', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a')
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5450bffb-d3ee-5214-9970-917d88d06379', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7e9e9de-30, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7e9e9de-30, col_values=(('qos', UUID('2ea04e4d-228b-4b3d-82c3-81cd3be37702')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7e9e9de-30, col_values=(('external_ids', {'iface-id': 'b7e9e9de-30cd-4372-a8c8-6ec480fc3520', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:75:07', 'vm-uuid': '947602c4-d7be-446e-87bc-b0137ac37f36'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:44 user nova-compute[74233]: INFO os_vif [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30')
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] No BDM found with device name hda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] No VIF found with MAC fa:16:3e:57:6d:60, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] No VIF found with MAC fa:16:3e:12:57:ca, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:14:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Using config drive
Oct 20 18:14:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Creating config drive at /opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36/disk.config
Oct 20 18:14:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgb6q6d39 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgb6q6d39" returned: 0 in 0.066s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:14:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance spawned successfully.
Oct 20 18:14:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: INFO nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Took 8.80 seconds to spawn the instance on the hypervisor.
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:14:45 user nova-compute[74233]: INFO nova.compute.manager [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Took 9.83 seconds to build instance.
Oct 20 18:14:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-558048a3-1044-496f-99eb-5737a6fe9a65 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.005s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:14:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance spawned successfully.
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-564bb31f-7fa5-4162-9655-852bc4500a0a req-1a64ddb4-92dc-4660-9247-46cafc30b14a service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-564bb31f-7fa5-4162-9655-852bc4500a0a req-1a64ddb4-92dc-4660-9247-46cafc30b14a service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-564bb31f-7fa5-4162-9655-852bc4500a0a req-1a64ddb4-92dc-4660-9247-46cafc30b14a service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-564bb31f-7fa5-4162-9655-852bc4500a0a req-1a64ddb4-92dc-4660-9247-46cafc30b14a service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-564bb31f-7fa5-4162-9655-852bc4500a0a req-1a64ddb4-92dc-4660-9247-46cafc30b14a service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:45 user nova-compute[74233]: WARNING nova.compute.manager [req-564bb31f-7fa5-4162-9655-852bc4500a0a req-1a64ddb4-92dc-4660-9247-46cafc30b14a service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state building and task_state spawning.
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:45 user nova-compute[74233]: INFO nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Took 7.89 seconds to spawn the instance on the hypervisor.
Oct 20 18:14:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:14:45 user nova-compute[74233]: INFO nova.compute.manager [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Took 9.56 seconds to build instance.
Oct 20 18:14:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6d9b05c4-2e29-442a-81f9-f6f8be749349 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.707s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-004cd895-e6b0-464d-87b5-a18ad8a0bee3 req-62c02f19-8efe-4310-b68d-155e42b58c8b service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-004cd895-e6b0-464d-87b5-a18ad8a0bee3 req-62c02f19-8efe-4310-b68d-155e42b58c8b service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-004cd895-e6b0-464d-87b5-a18ad8a0bee3 req-62c02f19-8efe-4310-b68d-155e42b58c8b service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.014s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-004cd895-e6b0-464d-87b5-a18ad8a0bee3 req-62c02f19-8efe-4310-b68d-155e42b58c8b service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-004cd895-e6b0-464d-87b5-a18ad8a0bee3 req-62c02f19-8efe-4310-b68d-155e42b58c8b service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:47 user nova-compute[74233]: WARNING nova.compute.manager [req-004cd895-e6b0-464d-87b5-a18ad8a0bee3 req-62c02f19-8efe-4310-b68d-155e42b58c8b service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec for instance with vm_state building and task_state spawning.
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:47 user nova-compute[74233]: WARNING nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd for instance with vm_state building and task_state spawning.
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:47 user nova-compute[74233]: WARNING nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd for instance with vm_state building and task_state spawning.
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:47 user nova-compute[74233]: WARNING nova.compute.manager [req-f0c2ca11-9c5f-474c-a198-00d34959165b req-0a2e5cd5-b2a5-4eff-b932-7053305c84f6 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a for instance with vm_state building and task_state spawning.
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec for instance with vm_state building and task_state spawning.
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 for instance with vm_state building and task_state spawning.
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 for instance with vm_state building and task_state spawning.
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-7e9ed788-4daf-408e-b349-69e07fb3f63f req-ff911f86-7fee-4165-9aba-1a14d67db579 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 for instance with vm_state building and task_state spawning.
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a for instance with vm_state building and task_state spawning.
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b for instance with vm_state building and task_state spawning.
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:49 user nova-compute[74233]: WARNING nova.compute.manager [req-5461cf69-e79c-47f7-bdae-8ddf35f544ec req-7b3faa29-030e-4b04-bcc8-b0c36a354786 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b for instance with vm_state building and task_state spawning.
Oct 20 18:14:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:51 user nova-compute[74233]: WARNING nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 for instance with vm_state building and task_state spawning.
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:51 user nova-compute[74233]: WARNING nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 for instance with vm_state building and task_state spawning.
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:14:51 user nova-compute[74233]: WARNING nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 for instance with vm_state building and task_state spawning.
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-changed-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Refreshing instance network info cache due to event network-changed-d361737e-8157-4051-9970-4ac903ac279b. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Acquiring lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Acquired lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG nova.network.neutron [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Refreshing network info cache for port d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:14:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance spawned successfully.
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.network.neutron [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updated VIF entry in instance network info cache for port d361737e-8157-4051-9970-4ac903ac279b. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.network.neutron [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updating instance_info_cache with network_info: [{"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2465b4b7-6a39-40eb-830b-c1559225d760 req-5a822b12-2835-459c-9e1d-c720c071d145 service nova] Releasing lock "refresh_cache-dbb80f53-2ced-431d-9315-c911c6b72f4c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:14:52 user nova-compute[74233]: INFO nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Took 14.32 seconds to spawn the instance on the hypervisor.
Oct 20 18:14:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:14:52 user nova-compute[74233]: INFO nova.compute.manager [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Took 117.77 seconds to build instance.
Oct 20 18:14:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b199e5fd-46dd-46bd-a177-70fa6edab068 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "947602c4-d7be-446e-87bc-b0137ac37f36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 117.895s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "947602c4-d7be-446e-87bc-b0137ac37f36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 117.023s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:52 user nova-compute[74233]: INFO nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] During sync_power_state the instance has a pending task (networking). Skip.
Oct 20 18:14:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "947602c4-d7be-446e-87bc-b0137ac37f36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:14:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:14:53 user nova-compute[74233]: INFO nova.compute.claims [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Claim successful on node user
Oct 20 18:14:53 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:14:53 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.841s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:14:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:14:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:14:54 user nova-compute[74233]: INFO nova.virt.block_device [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Booting with volume 6bab5f0b-1130-4a2f-b0f6-f32751698984 at /dev/vda
Oct 20 18:14:54 user nova-compute[74233]: DEBUG nova.policy [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04da36886f4a414cb75546d7fb188795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cfb373bc1442729225e42dd93218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG os_brick.utils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7d10e-15c8-4bdc-9d16-82e5b7b85345]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7b2e9-2448-4863-b7ac-7e1612879dcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e93d6a-df90-48f8-af27-6dac45004e65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d584624-e40e-4bdf-b94e-f5ed1f72762c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:14:54 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:14:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53c058-c4a3-438d-b2fb-64ff13ff324e]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG os_brick.utils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:14:54 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating existing volume attachment record: 4d1bfe83-1e9e-4118-92c9-a8d778fa2691 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:14:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully created port: e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully created port: 3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:56 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully created port: b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-changed-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Refreshing instance network info cache due to event network-changed-e1d6651b-0fe2-47f6-ba08-7d8db7c28342. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] Acquiring lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] Acquired lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:57 user nova-compute[74233]: DEBUG nova.network.neutron [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Refreshing network info cache for port e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:57 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully created port: ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updated VIF entry in instance network info cache for port e1d6651b-0fe2-47f6-ba08-7d8db7c28342. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "interface-e0124740-defc-4aff-9a68-9c3604f1d3c9-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "interface-e0124740-defc-4aff-9a68-9c3604f1d3c9-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.objects.instance [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'flavor' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b05be9a4-929a-4753-8f60-34a22afe0268 req-5c0b439b-2737-45ef-bf66-6f0daf88cfcd service nova] Releasing lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully created port: 86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.objects.instance [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'pci_requests' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.objects.base [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Object Instance<e0124740-defc-4aff-9a68-9c3604f1d3c9> lazy-loaded attributes: flavor,pci_requests {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:14:58 user nova-compute[74233]: DEBUG nova.policy [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bc0d56bcb4244c4a8f15522ca7fc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241507110dbc42719d74f9c1c8795d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Successfully created port: 866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-e0b50651-f865-4c34-8080-f3eaaa4d35ed. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJzmtBZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:14:59 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:59 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:14:59 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf80f8-c052-4191-9db8-6a748c0511f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:14:59 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-694e9fb1-5204-4729-95c6-5c95afea7cd5 req-df6172eb-d425-4d70-b9be-eeaf4f36f420 service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efc52d5-5225-4945-8020-630a16bf57fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f] added
Oct 20 18:14:59 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:14:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec39ac2-8255-492b-83a5-032fd96a15a0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f1b141-b385-4a12-aea1-cdc1d7037ed6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJzmtBZv {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJzmtBZv" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43e257-eb21-4ff2-9147-15996c259728]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iJzmtBZv'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: 3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[699938fb-816e-43f7-a343-7a5eced6a9ab]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaac004-eea7-4cac-aeb5-712a89d6d973]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f30adf-ff8a-439a-a706-d588d6d4cf78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260]
Oct 20 18:15:00 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260] successful.
Oct 20 18:15:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884987e-8f06-4c97-9781-00d09658e661]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Successfully updated port: 866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14451ff-57ee-4453-804a-868c7ddb39a7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:00 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquired lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.041s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98443580-9efb-494a-856f-79726187ed5b]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJzmtBZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-changed-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Refreshing instance network info cache due to event network-changed-866b88b7-f500-46a4-8683-5e19cf96dad8. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] Acquiring lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: 482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Releasing lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] Acquired lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Refreshing network info cache for port 866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG os_vif [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b599675-503a-523b-991b-102f5ddf990a', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap866b88b7-f5, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap866b88b7-f5, col_values=(('qos', UUID('11db6094-c51d-43fa-92da-1e3ce12a1c26')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap866b88b7-f5, col_values=(('external_ids', {'iface-id': '866b88b7-f500-46a4-8683-5e19cf96dad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:e7:16', 'vm-uuid': 'e0124740-defc-4aff-9a68-9c3604f1d3c9'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: INFO os_vif [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5')
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] attach device xml: <interface type="ethernet">
Oct 20 18:15:01 user nova-compute[74233]:   <mac address="fa:16:3e:1d:e7:16"/>
Oct 20 18:15:01 user nova-compute[74233]:   <model type="virtio"/>
Oct 20 18:15:01 user nova-compute[74233]:   <mtu size="1442"/>
Oct 20 18:15:01 user nova-compute[74233]:   <target dev="tap866b88b7-f5"/>
Oct 20 18:15:01 user nova-compute[74233]: </interface>
Oct 20 18:15:01 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== connect_volume: return (1514ms) {'type': 'block', 'scsi_wwn': '23161356136343532', 'path': '/dev/sdh'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161356136343532', 'path': '/dev/sdh'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.objects.instance [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-3bdc7d75-307c-4da7-bd53-1ea965385267. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port 3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:15:01 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:01 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:15:01 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:15:01 user nova-compute[74233]:   <serial>b85230a7-deba-467a-815c-122e9b74d38f</serial>
Oct 20 18:15:01 user nova-compute[74233]: </disk>
Oct 20 18:15:01 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-250d0788-416e-44ff-82d6-36f54b8978ab req-808b6ffe-8258-4c91-ae9e-36ed894503fe service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-250d0788-416e-44ff-82d6-36f54b8978ab req-808b6ffe-8258-4c91-ae9e-36ed894503fe service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-250d0788-416e-44ff-82d6-36f54b8978ab req-808b6ffe-8258-4c91-ae9e-36ed894503fe service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-250d0788-416e-44ff-82d6-36f54b8978ab req-808b6ffe-8258-4c91-ae9e-36ed894503fe service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-250d0788-416e-44ff-82d6-36f54b8978ab req-808b6ffe-8258-4c91-ae9e-36ed894503fe service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:15:01 user nova-compute[74233]: WARNING nova.compute.manager [req-250d0788-416e-44ff-82d6-36f54b8978ab req-808b6ffe-8258-4c91-ae9e-36ed894503fe service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 for instance with vm_state active and task_state None.
Oct 20 18:15:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No BDM found with device name hda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No VIF found with MAC fa:16:3e:77:e9:45, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: 3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:15:02 user nova-compute[74233]:   <nova:package version="0.0.0"/>
Oct 20 18:15:02 user nova-compute[74233]:   <nova:name>tempest-device-tagging-server-1201646160</nova:name>
Oct 20 18:15:02 user nova-compute[74233]:   <nova:creationTime>2023-10-20 18:15:02</nova:creationTime>
Oct 20 18:15:02 user nova-compute[74233]:   <nova:flavor name="m1.tiny">
Oct 20 18:15:02 user nova-compute[74233]:     <nova:memory>512</nova:memory>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:disk>1</nova:disk>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:swap>0</nova:swap>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:vcpus>1</nova:vcpus>
Oct 20 18:15:02 user nova-compute[74233]:   </nova:flavor>
Oct 20 18:15:02 user nova-compute[74233]:   <nova:owner>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:user uuid="1bc0d56bcb4244c4a8f15522ca7fc78a">tempest-TaggedAttachmentsTest-1226898318-project-member</nova:user>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:project uuid="241507110dbc42719d74f9c1c8795d7f">tempest-TaggedAttachmentsTest-1226898318</nova:project>
Oct 20 18:15:02 user nova-compute[74233]:   </nova:owner>
Oct 20 18:15:02 user nova-compute[74233]:   <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:15:02 user nova-compute[74233]:   <nova:ports>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:port uuid="e1d6651b-0fe2-47f6-ba08-7d8db7c28342">
Oct 20 18:15:02 user nova-compute[74233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:15:02 user nova-compute[74233]:     </nova:port>
Oct 20 18:15:02 user nova-compute[74233]:     <nova:port uuid="866b88b7-f500-46a4-8683-5e19cf96dad8">
Oct 20 18:15:02 user nova-compute[74233]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Oct 20 18:15:02 user nova-compute[74233]:     </nova:port>
Oct 20 18:15:02 user nova-compute[74233]:   </nova:ports>
Oct 20 18:15:02 user nova-compute[74233]: </nova:instance>
Oct 20 18:15:02 user nova-compute[74233]:  {{(pid=74233) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-66c26d43-ba42-4784-a14a-c07cbb4c3cf9 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "interface-e0124740-defc-4aff-9a68-9c3604f1d3c9-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.990s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-482ffd97-c560-48db-9a6d-e31105c795d8. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port 482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updated VIF entry in instance network info cache for port 866b88b7-f500-46a4-8683-5e19cf96dad8. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b92b547b-93d1-4411-bd5f-a04d8c86d34b req-0478a962-6090-4f88-95bc-b04ac6f5edc6 service nova] Releasing lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73ee30f7-26c7-4f66-838d-d828c32d99c7 req-7a74b8a4-95f4-48b4-889a-a91c90464452 service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] No VIF found with MAC fa:16:3e:a2:57:02, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.objects.instance [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'flavor' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-39b43e1e-8893-441c-aa2f-9900fcba0e30 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.146s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:03 user nova-compute[74233]: INFO nova.compute.manager [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Attaching volume 47e628b1-b063-4855-be9c-f61bb16b393f to /dev/vdb
Oct 20 18:15:03 user nova-compute[74233]: DEBUG os_brick.utils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c0351-8cef-4509-a74c-95e7ac5b6600]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37c4c68-19c8-43e5-b227-4490afb767c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aa35c5-550d-4778-a533-a2c621941709]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81120a-2065-41fe-958c-96fb34e7f5b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:15:03 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abad4ef-ca20-4981-9b78-c76cacbcb9a2]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG os_brick.utils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating existing volume attachment record: e084dea6-29ce-4fd4-a4a1-bbf18ac0a91f {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-3fa496b2-da99-4d66-aff9-7300f3e53104. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port 3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Updating instance_info_cache with network_info: [{"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-c309386c-5cca-46e0-96b9-754e82d47e3e" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-6aa7cb90-179a-46d4-a6bd-43322649c0b9 req-d69bcde5-303a-454f-924b-ee2c3129c182 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6aa7cb90-179a-46d4-a6bd-43322649c0b9 req-d69bcde5-303a-454f-924b-ee2c3129c182 service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6aa7cb90-179a-46d4-a6bd-43322649c0b9 req-d69bcde5-303a-454f-924b-ee2c3129c182 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6aa7cb90-179a-46d4-a6bd-43322649c0b9 req-d69bcde5-303a-454f-924b-ee2c3129c182 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-6aa7cb90-179a-46d4-a6bd-43322649c0b9 req-d69bcde5-303a-454f-924b-ee2c3129c182 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:15:03 user nova-compute[74233]: WARNING nova.compute.manager [req-6aa7cb90-179a-46d4-a6bd-43322649c0b9 req-d69bcde5-303a-454f-924b-ee2c3129c182 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 for instance with vm_state active and task_state None.
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-b70b5aab-5ae7-4ab2-a185-33e1b70cc291. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4fb4fc53-a8ff-4246-814a-1f208e3138ce req-8cf3a0ea-43ee-4b0d-80f1-65238d1d2328 service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:04 user nova-compute[74233]: INFO nova.compute.manager [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Detaching volume 7a07d1b2-ce0c-412a-95c1-dda74d52945f
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:04 user nova-compute[74233]: INFO nova.virt.block_device [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attempting to driver detach volume 7a07d1b2-ce0c-412a-95c1-dda74d52945f from mountpoint /dev/vdb
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Attempting to detach device vdb from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:15:04 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:04 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:15:04 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:15:04 user nova-compute[74233]:   <serial>7a07d1b2-ce0c-412a-95c1-dda74d52945f</serial>
Oct 20 18:15:04 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:15:04 user nova-compute[74233]: </disk>
Oct 20 18:15:04 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:15:04 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully detached device vdb from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the persistent domain config.
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:15:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:15:04 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:04 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:15:04 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:15:04 user nova-compute[74233]:   <serial>7a07d1b2-ce0c-412a-95c1-dda74d52945f</serial>
Oct 20 18:15:04 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:15:04 user nova-compute[74233]: </disk>
Oct 20 18:15:04 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Successfully updated port: 86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-ea450dd9-f552-4ade-9342-7e288f6d4ad5. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:15:06 user nova-compute[74233]: INFO nova.compute.claims [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Claim successful on node user
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance network_info: |[{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.network.neutron [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:15:08 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.network.neutron [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:15:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:15:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=25.17007827758789GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:15:08 user nova-compute[74233]: INFO nova.virt.block_device [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Booting with volume snapshot 6b86c3d3-5736-4a7f-8272-2ed0eb3f8669 at /dev/vda
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.policy [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10447188fbd74b18ba64fc8e64d267c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b592b103d8084815bf6d3132c1215feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 38f3b094-18c4-492a-bb68-fc687012e0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 947602c4-d7be-446e-87bc-b0137ac37f36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dbb80f53-2ced-431d-9315-c911c6b72f4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e0124740-defc-4aff-9a68-9c3604f1d3c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 69779d06-b30a-4986-a7ee-b7d365236f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e4677c3b-49b7-46f3-9539-7967340b93c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updated VIF entry in instance network info cache for port ea450dd9-f552-4ade-9342-7e288f6d4ad5. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-86d00573-f6f4-4818-af54-87e252612426. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port 86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updated VIF entry in instance network info cache for port 86d00573-f6f4-4818-af54-87e252612426. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2200f46a-1cf9-45e4-93a2-3e8d73914e66 req-97de2905-c538-4701-a13f-35db516ba8fb service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Successfully created port: 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Successfully updated port: 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquired lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-changed-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Refreshing instance network info cache due to event network-changed-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:15:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] Acquiring lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updating instance_info_cache with network_info: [{"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Releasing lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Instance network_info: |[{"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] Acquired lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Refreshing network info cache for port 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updated VIF entry in instance network info cache for port 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updating instance_info_cache with network_info: [{"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:15:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-336ab815-0edf-41b4-a3d1-c9582119abbb req-c11a8fee-fb72-4eb6-a8e7-d0eb7db8af56 service nova] Releasing lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:15:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 38f3b094-18c4-492a-bb68-fc687012e0ce is timed out.
Oct 20 18:15:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully detached device vdb from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the live domain config.
Oct 20 18:15:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRzDoPEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:15:25 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b25e3e-57ef-43ab-8e22-659955e6a276]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:15:25 user nova-compute[74233]: No targets found.
Oct 20 18:15:25 user nova-compute[74233]: iSNS:
Oct 20 18:15:25 user nova-compute[74233]: No targets found.
Oct 20 18:15:25 user nova-compute[74233]: STATIC:
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:15:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:25 user nova-compute[74233]: FIRMWARE:
Oct 20 18:15:25 user nova-compute[74233]: No targets found.
Oct 20 18:15:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:15:25 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:15:25 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[113e3ab6-cdd0-4b73-b83f-277371b178e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6588098b-0993-4a18-a56b-430402c1eca8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:25 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970420310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[421cff97-101f-492b-9eb1-4c757528673c]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea63377-0ce6-4767-936f-230224131718]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[100d9041-b5a6-41ac-8aee-984dd663e225]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc1dff-c42e-404d-869d-69af2bccfdb2]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7202e88c-6c57-4ae8-981a-091428b149fc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f07faf-5ae2-42a0-8108-2e6335b48987]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260]
Oct 20 18:15:25 user nova-compute[74233]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f, portal: 172.16.0.220,3260] successful.
Oct 20 18:15:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a07d1b2-ce0c-412a-95c1-dda74d52945f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40fa232-7ce4-4928-8237-680738922367]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== disconnect_volume: return (335ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:15:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:15:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b4257c9d-0551-4822-a663-b40d212bd616 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.055s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:27 user nova-compute[74233]: INFO nova.compute.manager [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Detaching volume b85230a7-deba-467a-815c-122e9b74d38f
Oct 20 18:15:27 user nova-compute[74233]: INFO nova.virt.block_device [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Attempting to driver detach volume b85230a7-deba-467a-815c-122e9b74d38f from mountpoint /dev/vdc
Oct 20 18:15:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Attempting to detach device vdc from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:15:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:15:27 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:27 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:15:27 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:15:27 user nova-compute[74233]:   <serial>b85230a7-deba-467a-815c-122e9b74d38f</serial>
Oct 20 18:15:27 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 18:15:27 user nova-compute[74233]: </disk>
Oct 20 18:15:27 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:15:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully detached device vdc from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the persistent domain config.
Oct 20 18:15:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:15:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:15:27 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:27 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:15:27 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:15:27 user nova-compute[74233]:   <serial>b85230a7-deba-467a-815c-122e9b74d38f</serial>
Oct 20 18:15:27 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 18:15:27 user nova-compute[74233]: </disk>
Oct 20 18:15:27 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:15:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:15:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:15:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:15:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:15:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:15:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxBZNqLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:15:44 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:15:44 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:15:44 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e875fd45-6490-46be-a04c-f7e91273b9c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:15:44 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d911f-a120-4f26-9dd7-9c1dd43ba8cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f] added
Oct 20 18:15:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c65642-e8fd-46eb-8f59-4df55e0e59aa]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b0017-68fe-48fd-9ccc-a392a98c800d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: INFO nova.virt.block_device [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Booting with volume 8b921a80-683b-49f8-8832-43dc5ab778c2 at /dev/vdb
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxBZNqLh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxBZNqLh" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee789d-68b8-443e-a55d-048152fd8989]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxBZNqLh'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd94f9b2-d7fb-4e66-ba60-fee898bd5fa0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.utils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[999420ce-3645-4934-91d5-7a2ea63e9b83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229cbbd-4fc9-4185-8731-4a24c8350212]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:44 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f48fbb-3f69-437d-a8b8-f3a7203a0b50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee259e2-dd99-49d9-9b51-aeb7df95807c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[147110ee-394b-4c44-8817-7a47d5159080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096e832-2abc-4067-a4a7-33d73cb1cc5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260]
Oct 20 18:15:44 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260] successful.
Oct 20 18:15:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:15:44 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:15:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d6181a-2f2a-4e74-a378-4aea3a60c3db]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG os_brick.utils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:44 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating existing volume attachment record: 29629c15-4b4d-4ac1-b93a-f9308f26372d {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1245876-35d2-464b-985a-4a06fe362cd4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a5726d-93c7-4ed3-9820-390ba5ae2637]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)
Oct 20 18:15:45 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[def6293b-cf09-4a0f-a81f-5ea489b82606]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:15:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxBZNqLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26663656462366263', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663656462366263', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG nova.objects.instance [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'flavor' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:15:46 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:46 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:15:46 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:15:46 user nova-compute[74233]:   <serial>47e628b1-b063-4855-be9c-f61bb16b393f</serial>
Oct 20 18:15:46 user nova-compute[74233]: </disk>
Oct 20 18:15:46 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No BDM found with device name hda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] No VIF found with MAC fa:16:3e:77:e9:45, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:15:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-82c34835-3792-4701-bd2a-300400fa1852 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.350s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:15:47 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 38f3b094-18c4-492a-bb68-fc687012e0ce is timed out.
Oct 20 18:15:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully detached device vdc from instance 38f3b094-18c4-492a-bb68-fc687012e0ce from the live domain config.
Oct 20 18:15:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJzmtBZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:15:47 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0957037-6699-47b9-9eac-768b9611d4b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:15:47 user nova-compute[74233]: No targets found.
Oct 20 18:15:47 user nova-compute[74233]: iSNS:
Oct 20 18:15:47 user nova-compute[74233]: No targets found.
Oct 20 18:15:47 user nova-compute[74233]: STATIC:
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f
Oct 20 18:15:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:15:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:15:47 user nova-compute[74233]: FIRMWARE:
Oct 20 18:15:47 user nova-compute[74233]: No targets found.
Oct 20 18:15:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:15:47 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:15:47 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545cc37-d06a-4c3e-9341-cd9ee5775002]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[528fc663-4e93-409c-b2a4-200f87422e27]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)
Oct 20 18:15:47 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:15:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb981b72cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f'): ({'sdh'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Removing single pathed devices sdh {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a46321-07ff-4707-8f17-b7e32aa7d04f]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff85accf-2000-4c0a-8b7e-75390da64b3e]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Flushing IO for device /dev/sdh {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb5fc5a-b389-4052-b4ff-9b80fe678ec2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[05da2b80-03eb-42cd-9976-ed3e0088e1da]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[368fe769-7754-4a1b-a7bd-fcd62cde1056]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aec32c7-43e8-4c34-a0bc-1ae24e08f73c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260]
Oct 20 18:15:47 user nova-compute[74233]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f, portal: 172.16.0.220,3260] successful.
Oct 20 18:15:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85230a7-deba-467a-815c-122e9b74d38f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31acbcf0-d4c5-46d6-96a6-ad3803f74dd5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] <== disconnect_volume: return (342ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:15:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:15:47 user nova-compute[74233]: INFO nova.compute.manager [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Detaching volume 47e628b1-b063-4855-be9c-f61bb16b393f
Oct 20 18:15:48 user nova-compute[74233]: INFO nova.virt.block_device [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Attempting to driver detach volume 47e628b1-b063-4855-be9c-f61bb16b393f from mountpoint /dev/vdb
Oct 20 18:15:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Attempting to detach device vdb from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:15:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:15:48 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:48 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:15:48 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:15:48 user nova-compute[74233]:   <serial>47e628b1-b063-4855-be9c-f61bb16b393f</serial>
Oct 20 18:15:48 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 18:15:48 user nova-compute[74233]: </disk>
Oct 20 18:15:48 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:15:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully detached device vdb from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the persistent domain config.
Oct 20 18:15:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:15:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:15:48 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:15:48 user nova-compute[74233]:   <source dev="/dev/sdd"/>
Oct 20 18:15:48 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:15:48 user nova-compute[74233]:   <serial>47e628b1-b063-4855-be9c-f61bb16b393f</serial>
Oct 20 18:15:48 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 18:15:48 user nova-compute[74233]: </disk>
Oct 20 18:15:48 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:15:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG os_brick.utils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1eb40b-6f65-42d6-b94e-6a6b1b71acdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c60fe83-066f-4a82-9407-16262a4ffb3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc7132-44ce-4cb6-8fc2-f7e46fb6a079]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[382af08a-0962-47c3-a6bc-879549171179]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:15:49 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:15:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f12e8d-a7cf-4d6f-a79c-0d5be230d130]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG os_brick.utils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:15:49 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updating existing volume attachment record: 57173b2e-9f7d-4ad0-b9ac-901801167ce9 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:15:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:15:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:15:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:15:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:15:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:15:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:16:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating instance_info_cache with network_info: [{"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-38f3b094-18c4-492a-bb68-fc687012e0ce" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG nova.objects.instance [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-71ca4ffe-158e-4463-bada-68ade83f26c1 tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.351s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:04 user nova-compute[74233]: INFO nova.virt.block_device [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Booting with volume 039588a1-7d9f-4513-80a3-ec1074afd743 at /dev/vdc
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG os_brick.utils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a500dc-6a2d-4a79-b0c5-609db7ac390e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7475MB free_disk=25.15450668334961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:05 user nova-compute[74233]: INFO nova.compute.manager [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Terminating instance
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[343c19b5-da41-48db-8818-fc0a21ac97e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c3f56-5cfa-4ca9-b228-edb28f11420b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22b80c0-ac4e-456e-b28a-2ef238afdd63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:16:05 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b792e6-79db-4d27-846e-edc9d83f90ca]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG os_brick.utils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== get_connector_properties: return (609ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating existing volume attachment record: 121363a0-12c7-45ff-8a67-473d3fa6e751 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 38f3b094-18c4-492a-bb68-fc687012e0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 947602c4-d7be-446e-87bc-b0137ac37f36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dbb80f53-2ced-431d-9315-c911c6b72f4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e0124740-defc-4aff-9a68-9c3604f1d3c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 69779d06-b30a-4986-a7ee-b7d365236f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e4677c3b-49b7-46f3-9539-7967340b93c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-ad6a1c0a-84cb-487f-aea6-7c8ed85ee276 req-b1f002a1-49e7-4efc-b832-eb04c05d6ac1 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-vif-unplugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ad6a1c0a-84cb-487f-aea6-7c8ed85ee276 req-b1f002a1-49e7-4efc-b832-eb04c05d6ac1 service nova] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ad6a1c0a-84cb-487f-aea6-7c8ed85ee276 req-b1f002a1-49e7-4efc-b832-eb04c05d6ac1 service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ad6a1c0a-84cb-487f-aea6-7c8ed85ee276 req-b1f002a1-49e7-4efc-b832-eb04c05d6ac1 service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-ad6a1c0a-84cb-487f-aea6-7c8ed85ee276 req-b1f002a1-49e7-4efc-b832-eb04c05d6ac1 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] No waiting events found dispatching network-vif-unplugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-ad6a1c0a-84cb-487f-aea6-7c8ed85ee276 req-b1f002a1-49e7-4efc-b832-eb04c05d6ac1 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-vif-unplugged-6424d183-3ff0-49be-b22f-8515a0dbf3df for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Instance destroyed successfully.
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lazy-loading 'resources' on Instance uuid 38f3b094-18c4-492a-bb68-fc687012e0ce {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1895803143',display_name='tempest-AttachVolumeTestJSON-server-1895803143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1895803143',id=14,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg9x+zDJZioZ1a8QO7SCPl2mKBPKXtqdZsUfdP67oXIa/wEkPo7W0AzUyTT6997Kdof4hyXGmzZpQLf1JQ3bhfoLc0AZJ4wHYovRQBHfMOqgs5L5pWIXI0RA+UV0IRbAg==',key_name='tempest-keypair-73485482',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:12:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e5f6324b8b44903af56785a67af93d9',ramdisk_id='',reservation_id='r-zx7v9wty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1002715263',owner_user_name='tempest-AttachVolumeTestJSON-1002715263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:12:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c1e18569184b7ca8ce578e5e24bfc6',uuid=38f3b094-18c4-492a-bb68-fc687012e0ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converting VIF {"id": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "address": "fa:16:3e:a2:57:02", "network": {"id": "6d44731b-5fb5-4b87-bcaf-5991d06b2f7a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-294018150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e5f6324b8b44903af56785a67af93d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6424d183-3f", "ovs_interfaceid": "6424d183-3ff0-49be-b22f-8515a0dbf3df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG os_vif [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6424d183-3f, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4889a6a9-d497-4180-8ac5-fe241820b312) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:05 user nova-compute[74233]: INFO os_vif [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:57:02,bridge_name='br-int',has_traffic_filtering=True,id=6424d183-3ff0-49be-b22f-8515a0dbf3df,network=Network(6d44731b-5fb5-4b87-bcaf-5991d06b2f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6424d183-3f')
Oct 20 18:16:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Deleting instance files /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce_del
Oct 20 18:16:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Deletion of /opt/stack/data/nova/instances/38f3b094-18c4-492a-bb68-fc687012e0ce_del complete
Oct 20 18:16:06 user nova-compute[74233]: INFO nova.compute.manager [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 18:16:06 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:16:06 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:16:06 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:16:06 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:06 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Took 0.68 seconds to deallocate network for instance.
Oct 20 18:16:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:07 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Deleted allocations for instance 38f3b094-18c4-492a-bb68-fc687012e0ce
Oct 20 18:16:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3d8ab863-c4d6-4dba-a72b-9f55824aebda tempest-AttachVolumeTestJSON-1002715263 tempest-AttachVolumeTestJSON-1002715263-project-member] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] Acquiring lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] Lock "38f3b094-18c4-492a-bb68-fc687012e0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] No waiting events found dispatching network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:07 user nova-compute[74233]: WARNING nova.compute.manager [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received unexpected event network-vif-plugged-6424d183-3ff0-49be-b22f-8515a0dbf3df for instance with vm_state deleted and task_state None.
Oct 20 18:16:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-0a6f6d70-75e6-44af-a727-c20cb7511faa req-dc020922-a7dc-4cc9-8f1f-1695d45a0415 service nova] [instance: 38f3b094-18c4-492a-bb68-fc687012e0ce] Received event network-vif-deleted-6424d183-3ff0-49be-b22f-8515a0dbf3df {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 is timed out.
Oct 20 18:16:08 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully detached device vdb from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the live domain config.
Oct 20 18:16:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxBZNqLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:08 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd066bf-241c-4d2c-8fa0-0fa248a6b002]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:16:08 user nova-compute[74233]: No targets found.
Oct 20 18:16:08 user nova-compute[74233]: iSNS:
Oct 20 18:16:08 user nova-compute[74233]: No targets found.
Oct 20 18:16:08 user nova-compute[74233]: STATIC:
Oct 20 18:16:08 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176
Oct 20 18:16:08 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:08 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:08 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d
Oct 20 18:16:08 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:08 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:08 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:16:08 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:08 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:08 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148
Oct 20 18:16:08 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:08 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:08 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:16:08 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:08 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:08 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f
Oct 20 18:16:08 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:08 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:08 user nova-compute[74233]: FIRMWARE:
Oct 20 18:16:08 user nova-compute[74233]: No targets found.
Oct 20 18:16:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:16:08 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:16:08 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74554051-48af-4336-bd3f-7feb05c06dd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13531a-47a7-4506-9afc-e26576d84661]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f (non-flash)
Oct 20 18:16:08 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb98a8dab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36097a8-0e5a-4211-85df-067b4e037122]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f08198-8ece-43ec-a69c-5b83ee9ffa50]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf310ce-ad15-4724-b3c8-10263f8f4a6c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e475fc95-f4ab-4ac7-8e71-f21454711f8e]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39784475-78df-462e-b4b5-7c0689f1319f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db332f2-16bb-4522-bfbc-c815801e580d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260]
Oct 20 18:16:08 user nova-compute[74233]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e628b1-b063-4855-be9c-f61bb16b393f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee68b38d-c54a-4f45-b3c7-9cbc9d3f09e1]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] <== disconnect_volume: return (306ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:16:09 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Creating image(s)
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Ensure instance console log exists: /opt/stack/data/nova/instances/e4677c3b-49b7-46f3-9539-7967340b93c5/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Start _get_guest_xml network_info=[{"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T18:14:54Z,direct_url=<?>,disk_format='qcow2',id=0e763535-47e8-4b88-8b30-fadca3a80106,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2103501398',owner='b592b103d8084815bf6d3132c1215feb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T18:14:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '57173b2e-9f7d-4ad0-b9ac-901801167ce9', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJpVbkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4677c3b-49b7-46f3-9539-7967340b93c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8c4c0ca-364a-40b6-a2f0-abee09e73cb1', 'serial': 'a8c4c0ca-364a-40b6-a2f0-abee09e73cb1'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:16:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T18:14:54Z,direct_url=<?>,disk_format='qcow2',id=0e763535-47e8-4b88-8b30-fadca3a80106,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2103501398',owner='b592b103d8084815bf6d3132c1215feb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T18:14:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJpVbkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:09 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:09 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:09 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e6175-b916-4328-9068-8c345f953c16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:16:09 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fbd840-33b5-49a8-ac07-32fb10476417]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1] added
Oct 20 18:16:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1ae0b-ea16-4f35-a6fe-edf22e1b67d9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8769a971-6c2b-4e3f-8e3f-4ef1259b8cf6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJpVbkwA {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJpVbkwA" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6022a68-6951-40a8-8deb-658c621f7cf5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJpVbkwA'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d851e8a-71a6-4504-840c-f03430f21b6c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03d2f92-a682-42d3-84aa-36c9dc21576f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e401948-34c2-4468-b32a-62121fa71c2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260]
Oct 20 18:16:09 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b8970-e584-44be-90b4-239e1bf186ac]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a9688-97ea-4177-bad5-b780ea5c8d67]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f2a853-b7ab-4148-b1de-310b408c7de5]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'flavor' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c6939a7e-2838-4f09-8eaa-3e29aa9d7c6d tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.787s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "interface-e0124740-defc-4aff-9a68-9c3604f1d3c9-866b88b7-f500-46a4-8683-5e19cf96dad8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "interface-e0124740-defc-4aff-9a68-9c3604f1d3c9-866b88b7-f500-46a4-8683-5e19cf96dad8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:09 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'flavor' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1d:e7:16"/><model type="virtio"/><mtu size="1442"/><target dev="tap866b88b7-f5"/></interface> {{(pid=74233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1d:e7:16"/><model type="virtio"/><mtu size="1442"/><target dev="tap866b88b7-f5"/></interface> {{(pid=74233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Attempting to detach device tap866b88b7-f5 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] detach device xml: <interface type="ethernet">
Oct 20 18:16:10 user nova-compute[74233]:   <mac address="fa:16:3e:1d:e7:16"/>
Oct 20 18:16:10 user nova-compute[74233]:   <model type="virtio"/>
Oct 20 18:16:10 user nova-compute[74233]:   <mtu size="1442"/>
Oct 20 18:16:10 user nova-compute[74233]:   <target dev="tap866b88b7-f5"/>
Oct 20 18:16:10 user nova-compute[74233]: </interface>
Oct 20 18:16:10 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1d:e7:16"/><model type="virtio"/><mtu size="1442"/><target dev="tap866b88b7-f5"/></interface> {{(pid=74233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:1d:e7:16"/><model type="virtio"/><mtu size="1442"/><target dev="tap866b88b7-f5"/></interface>not found in domain: <domain type='kvm' id='20'>
Oct 20 18:16:10 user nova-compute[74233]:   <name>instance-00000012</name>
Oct 20 18:16:10 user nova-compute[74233]:   <uuid>e0124740-defc-4aff-9a68-9c3604f1d3c9</uuid>
Oct 20 18:16:10 user nova-compute[74233]:   <metadata>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:16:10 user nova-compute[74233]:   <nova:package version="0.0.0"/>
Oct 20 18:16:10 user nova-compute[74233]:   <nova:name>tempest-device-tagging-server-1201646160</nova:name>
Oct 20 18:16:10 user nova-compute[74233]:   <nova:creationTime>2023-10-20 18:15:02</nova:creationTime>
Oct 20 18:16:10 user nova-compute[74233]:   <nova:flavor name="m1.tiny">
Oct 20 18:16:10 user nova-compute[74233]:     <nova:memory>512</nova:memory>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:disk>1</nova:disk>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:swap>0</nova:swap>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:vcpus>1</nova:vcpus>
Oct 20 18:16:10 user nova-compute[74233]:   </nova:flavor>
Oct 20 18:16:10 user nova-compute[74233]:   <nova:owner>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:user uuid="1bc0d56bcb4244c4a8f15522ca7fc78a">tempest-TaggedAttachmentsTest-1226898318-project-member</nova:user>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:project uuid="241507110dbc42719d74f9c1c8795d7f">tempest-TaggedAttachmentsTest-1226898318</nova:project>
Oct 20 18:16:10 user nova-compute[74233]:   </nova:owner>
Oct 20 18:16:10 user nova-compute[74233]:   <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:16:10 user nova-compute[74233]:   <nova:ports>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:port uuid="e1d6651b-0fe2-47f6-ba08-7d8db7c28342">
Oct 20 18:16:10 user nova-compute[74233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:16:10 user nova-compute[74233]:     </nova:port>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:port uuid="866b88b7-f500-46a4-8683-5e19cf96dad8">
Oct 20 18:16:10 user nova-compute[74233]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Oct 20 18:16:10 user nova-compute[74233]:     </nova:port>
Oct 20 18:16:10 user nova-compute[74233]:   </nova:ports>
Oct 20 18:16:10 user nova-compute[74233]: </nova:instance>
Oct 20 18:16:10 user nova-compute[74233]:   </metadata>
Oct 20 18:16:10 user nova-compute[74233]:   <memory unit='KiB'>524288</memory>
Oct 20 18:16:10 user nova-compute[74233]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 18:16:10 user nova-compute[74233]:   <vcpu placement='static'>1</vcpu>
Oct 20 18:16:10 user nova-compute[74233]:   <resource>
Oct 20 18:16:10 user nova-compute[74233]:     <partition>/machine</partition>
Oct 20 18:16:10 user nova-compute[74233]:   </resource>
Oct 20 18:16:10 user nova-compute[74233]:   <sysinfo type='smbios'>
Oct 20 18:16:10 user nova-compute[74233]:     <system>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name='version'>0.0.0</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name='serial'>e0124740-defc-4aff-9a68-9c3604f1d3c9</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name='uuid'>e0124740-defc-4aff-9a68-9c3604f1d3c9</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name='family'>Virtual Machine</entry>
Oct 20 18:16:10 user nova-compute[74233]:     </system>
Oct 20 18:16:10 user nova-compute[74233]:   </sysinfo>
Oct 20 18:16:10 user nova-compute[74233]:   <os>
Oct 20 18:16:10 user nova-compute[74233]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 18:16:10 user nova-compute[74233]:     <boot dev='hd'/>
Oct 20 18:16:10 user nova-compute[74233]:     <smbios mode='sysinfo'/>
Oct 20 18:16:10 user nova-compute[74233]:   </os>
Oct 20 18:16:10 user nova-compute[74233]:   <features>
Oct 20 18:16:10 user nova-compute[74233]:     <acpi/>
Oct 20 18:16:10 user nova-compute[74233]:     <apic/>
Oct 20 18:16:10 user nova-compute[74233]:     <vmcoreinfo state='on'/>
Oct 20 18:16:10 user nova-compute[74233]:   </features>
Oct 20 18:16:10 user nova-compute[74233]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 18:16:10 user nova-compute[74233]:     <model fallback='forbid'>Nehalem</model>
Oct 20 18:16:10 user nova-compute[74233]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 18:16:10 user nova-compute[74233]:     <feature policy='require' name='vme'/>
Oct 20 18:16:10 user nova-compute[74233]:     <feature policy='require' name='x2apic'/>
Oct 20 18:16:10 user nova-compute[74233]:     <feature policy='require' name='hypervisor'/>
Oct 20 18:16:10 user nova-compute[74233]:   </cpu>
Oct 20 18:16:10 user nova-compute[74233]:   <clock offset='utc'>
Oct 20 18:16:10 user nova-compute[74233]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 18:16:10 user nova-compute[74233]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 18:16:10 user nova-compute[74233]:     <timer name='hpet' present='no'/>
Oct 20 18:16:10 user nova-compute[74233]:   </clock>
Oct 20 18:16:10 user nova-compute[74233]:   <on_poweroff>destroy</on_poweroff>
Oct 20 18:16:10 user nova-compute[74233]:   <on_reboot>restart</on_reboot>
Oct 20 18:16:10 user nova-compute[74233]:   <on_crash>destroy</on_crash>
Oct 20 18:16:10 user nova-compute[74233]:   <devices>
Oct 20 18:16:10 user nova-compute[74233]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 18:16:10 user nova-compute[74233]:     <disk type='file' device='disk'>
Oct 20 18:16:10 user nova-compute[74233]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 18:16:10 user nova-compute[74233]:       <source file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk' index='2'/>
Oct 20 18:16:10 user nova-compute[74233]:       <backingStore type='file' index='3'>
Oct 20 18:16:10 user nova-compute[74233]:         <format type='raw'/>
Oct 20 18:16:10 user nova-compute[74233]:         <source file='/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48'/>
Oct 20 18:16:10 user nova-compute[74233]:         <backingStore/>
Oct 20 18:16:10 user nova-compute[74233]:       </backingStore>
Oct 20 18:16:10 user nova-compute[74233]:       <target dev='vda' bus='virtio'/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='virtio-disk0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </disk>
Oct 20 18:16:10 user nova-compute[74233]:     <disk type='file' device='cdrom'>
Oct 20 18:16:10 user nova-compute[74233]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 18:16:10 user nova-compute[74233]:       <source file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.config' index='1'/>
Oct 20 18:16:10 user nova-compute[74233]:       <backingStore/>
Oct 20 18:16:10 user nova-compute[74233]:       <target dev='hda' bus='ide'/>
Oct 20 18:16:10 user nova-compute[74233]:       <readonly/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='ide0-0-0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </disk>
Oct 20 18:16:10 user nova-compute[74233]:     <controller type='usb' index='0' model='none'>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='usb'/>
Oct 20 18:16:10 user nova-compute[74233]:     </controller>
Oct 20 18:16:10 user nova-compute[74233]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='pci.0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </controller>
Oct 20 18:16:10 user nova-compute[74233]:     <controller type='ide' index='0'>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='ide'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 18:16:10 user nova-compute[74233]:     </controller>
Oct 20 18:16:10 user nova-compute[74233]:     <interface type='ethernet'>
Oct 20 18:16:10 user nova-compute[74233]:       <mac address='fa:16:3e:77:e9:45'/>
Oct 20 18:16:10 user nova-compute[74233]:       <target dev='tape1d6651b-0f'/>
Oct 20 18:16:10 user nova-compute[74233]:       <model type='virtio'/>
Oct 20 18:16:10 user nova-compute[74233]:       <mtu size='1442'/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='net0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </interface>
Oct 20 18:16:10 user nova-compute[74233]:     <interface type='ethernet'>
Oct 20 18:16:10 user nova-compute[74233]:       <mac address='fa:16:3e:1d:e7:16'/>
Oct 20 18:16:10 user nova-compute[74233]:       <target dev='tap866b88b7-f5'/>
Oct 20 18:16:10 user nova-compute[74233]:       <model type='virtio'/>
Oct 20 18:16:10 user nova-compute[74233]:       <mtu size='1442'/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='net1'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </interface>
Oct 20 18:16:10 user nova-compute[74233]:     <serial type='pty'>
Oct 20 18:16:10 user nova-compute[74233]:       <source path='/dev/pts/3'/>
Oct 20 18:16:10 user nova-compute[74233]:       <log file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/console.log' append='off'/>
Oct 20 18:16:10 user nova-compute[74233]:       <target type='isa-serial' port='0'>
Oct 20 18:16:10 user nova-compute[74233]:         <model name='isa-serial'/>
Oct 20 18:16:10 user nova-compute[74233]:       </target>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='serial0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </serial>
Oct 20 18:16:10 user nova-compute[74233]:     <console type='pty' tty='/dev/pts/3'>
Oct 20 18:16:10 user nova-compute[74233]:       <source path='/dev/pts/3'/>
Oct 20 18:16:10 user nova-compute[74233]:       <log file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/console.log' append='off'/>
Oct 20 18:16:10 user nova-compute[74233]:       <target type='serial' port='0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='serial0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </console>
Oct 20 18:16:10 user nova-compute[74233]:     <input type='mouse' bus='ps2'>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='input0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </input>
Oct 20 18:16:10 user nova-compute[74233]:     <input type='keyboard' bus='ps2'>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='input1'/>
Oct 20 18:16:10 user nova-compute[74233]:     </input>
Oct 20 18:16:10 user nova-compute[74233]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Oct 20 18:16:10 user nova-compute[74233]:       <listen type='address' address='0.0.0.0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </graphics>
Oct 20 18:16:10 user nova-compute[74233]:     <audio id='1' type='none'/>
Oct 20 18:16:10 user nova-compute[74233]:     <video>
Oct 20 18:16:10 user nova-compute[74233]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='video0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </video>
Oct 20 18:16:10 user nova-compute[74233]:     <memballoon model='virtio'>
Oct 20 18:16:10 user nova-compute[74233]:       <stats period='10'/>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='balloon0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </memballoon>
Oct 20 18:16:10 user nova-compute[74233]:     <rng model='virtio'>
Oct 20 18:16:10 user nova-compute[74233]:       <backend model='random'>/dev/urandom</backend>
Oct 20 18:16:10 user nova-compute[74233]:       <alias name='rng0'/>
Oct 20 18:16:10 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 18:16:10 user nova-compute[74233]:     </rng>
Oct 20 18:16:10 user nova-compute[74233]:   </devices>
Oct 20 18:16:10 user nova-compute[74233]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 18:16:10 user nova-compute[74233]:     <label>libvirt-e0124740-defc-4aff-9a68-9c3604f1d3c9</label>
Oct 20 18:16:10 user nova-compute[74233]:     <imagelabel>libvirt-e0124740-defc-4aff-9a68-9c3604f1d3c9</imagelabel>
Oct 20 18:16:10 user nova-compute[74233]:   </seclabel>
Oct 20 18:16:10 user nova-compute[74233]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 18:16:10 user nova-compute[74233]:     <label>+64055:+108</label>
Oct 20 18:16:10 user nova-compute[74233]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 18:16:10 user nova-compute[74233]:   </seclabel>
Oct 20 18:16:10 user nova-compute[74233]: </domain>
Oct 20 18:16:10 user nova-compute[74233]:  {{(pid=74233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 18:16:10 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully detached device tap866b88b7-f5 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the persistent domain config.
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] (1/8): Attempting to detach device tap866b88b7-f5 with device alias net1 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] detach device xml: <interface type="ethernet">
Oct 20 18:16:10 user nova-compute[74233]:   <mac address="fa:16:3e:1d:e7:16"/>
Oct 20 18:16:10 user nova-compute[74233]:   <model type="virtio"/>
Oct 20 18:16:10 user nova-compute[74233]:   <mtu size="1442"/>
Oct 20 18:16:10 user nova-compute[74233]:   <target dev="tap866b88b7-f5"/>
Oct 20 18:16:10 user nova-compute[74233]: </interface>
Oct 20 18:16:10 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Start waiting for the detach event from libvirt for device tap866b88b7-f5 with device alias net1 for instance e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJpVbkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23839616264383637', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839616264383637', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1127723358',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1127723358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1127723358',id=24,image_ref='0e763535-47e8-4b88-8b30-fadca3a80106',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGFDpTRXv2Lylq94D4+q7Sw6EOyBXo4HfH+Yv7htQOiCj+wfsSVpzphtfUrodDxh5X+d7Jq8uIwL6it0mxXT6WikaC3aJR9+JYY3zK2dTzwjHomrj/losMduf02BcHv9A==',key_name='tempest-keypair-841064752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-6ev6ir02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2006411708',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=e4677c3b-49b7-46f3-9539-7967340b93c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.objects.instance [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'pci_devices' on Instance uuid e4677c3b-49b7-46f3-9539-7967340b93c5 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:16:10 user nova-compute[74233]:   <uuid>e4677c3b-49b7-46f3-9539-7967340b93c5</uuid>
Oct 20 18:16:10 user nova-compute[74233]:   <name>instance-00000018</name>
Oct 20 18:16:10 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:16:10 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:16:10 user nova-compute[74233]:   <metadata>
Oct 20 18:16:10 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:16:10 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:16:10 user nova-compute[74233]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1127723358</nova:name>
Oct 20 18:16:10 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:16:09</nova:creationTime>
Oct 20 18:16:10 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:16:10 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:16:10 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:16:10 user nova-compute[74233]:       <nova:owner>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:user uuid="10447188fbd74b18ba64fc8e64d267c6">tempest-TestVolumeBootPattern-2006411708-project-member</nova:user>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:project uuid="b592b103d8084815bf6d3132c1215feb">tempest-TestVolumeBootPattern-2006411708</nova:project>
Oct 20 18:16:10 user nova-compute[74233]:       </nova:owner>
Oct 20 18:16:10 user nova-compute[74233]:       <nova:root type="image" uuid="0e763535-47e8-4b88-8b30-fadca3a80106"/>
Oct 20 18:16:10 user nova-compute[74233]:       <nova:ports>
Oct 20 18:16:10 user nova-compute[74233]:         <nova:port uuid="5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03">
Oct 20 18:16:10 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:16:10 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:10 user nova-compute[74233]:       </nova:ports>
Oct 20 18:16:10 user nova-compute[74233]:     </nova:instance>
Oct 20 18:16:10 user nova-compute[74233]:   </metadata>
Oct 20 18:16:10 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:16:10 user nova-compute[74233]:     <system>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name="serial">e4677c3b-49b7-46f3-9539-7967340b93c5</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name="uuid">e4677c3b-49b7-46f3-9539-7967340b93c5</entry>
Oct 20 18:16:10 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:16:10 user nova-compute[74233]:     </system>
Oct 20 18:16:10 user nova-compute[74233]:   </sysinfo>
Oct 20 18:16:10 user nova-compute[74233]:   <os>
Oct 20 18:16:10 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:16:10 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:16:10 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:16:10 user nova-compute[74233]:   </os>
Oct 20 18:16:10 user nova-compute[74233]:   <features>
Oct 20 18:16:10 user nova-compute[74233]:     <acpi/>
Oct 20 18:16:10 user nova-compute[74233]:     <apic/>
Oct 20 18:16:10 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:16:10 user nova-compute[74233]:   </features>
Oct 20 18:16:10 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:16:10 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:16:10 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:16:10 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:16:10 user nova-compute[74233]:   </clock>
Oct 20 18:16:10 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:16:10 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:16:10 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:16:10 user nova-compute[74233]:   </cpu>
Oct 20 18:16:10 user nova-compute[74233]:   <devices>
Oct 20 18:16:10 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:16:10 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:16:10 user nova-compute[74233]:       <source dev="/dev/sdd"/>
Oct 20 18:16:10 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:16:10 user nova-compute[74233]:       <serial>a8c4c0ca-364a-40b6-a2f0-abee09e73cb1</serial>
Oct 20 18:16:10 user nova-compute[74233]:     </disk>
Oct 20 18:16:10 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:10 user nova-compute[74233]:       <mac address="fa:16:3e:ea:d2:6e"/>
Oct 20 18:16:10 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:10 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:10 user nova-compute[74233]:       <target dev="tap5a47ca8b-a7"/>
Oct 20 18:16:10 user nova-compute[74233]:     </interface>
Oct 20 18:16:10 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:16:10 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/e4677c3b-49b7-46f3-9539-7967340b93c5/console.log" append="off"/>
Oct 20 18:16:10 user nova-compute[74233]:     </serial>
Oct 20 18:16:10 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:16:10 user nova-compute[74233]:     <video>
Oct 20 18:16:10 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:10 user nova-compute[74233]:     </video>
Oct 20 18:16:10 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:16:10 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:16:10 user nova-compute[74233]:     </rng>
Oct 20 18:16:10 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:16:10 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:16:10 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:16:10 user nova-compute[74233]:     </memballoon>
Oct 20 18:16:10 user nova-compute[74233]:   </devices>
Oct 20 18:16:10 user nova-compute[74233]: </domain>
Oct 20 18:16:10 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1127723358',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1127723358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1127723358',id=24,image_ref='0e763535-47e8-4b88-8b30-fadca3a80106',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGFDpTRXv2Lylq94D4+q7Sw6EOyBXo4HfH+Yv7htQOiCj+wfsSVpzphtfUrodDxh5X+d7Jq8uIwL6it0mxXT6WikaC3aJR9+JYY3zK2dTzwjHomrj/losMduf02BcHv9A==',key_name='tempest-keypair-841064752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-6ev6ir02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2006411708',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=e4677c3b-49b7-46f3-9539-7967340b93c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG os_vif [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bb7bc1f-51a1-5b6a-88ec-8d2f638fda97', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a47ca8b-a7, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a47ca8b-a7, col_values=(('qos', UUID('60784441-df94-4b65-97c9-047e1ec9fc16')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a47ca8b-a7, col_values=(('external_ids', {'iface-id': '5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:d2:6e', 'vm-uuid': 'e4677c3b-49b7-46f3-9539-7967340b93c5'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-fc2a5648-e908-42ce-8337-d6d9ef9eb9db req-41648b31-bf54-45c6-a476-2bdda517dfe9 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-unplugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fc2a5648-e908-42ce-8337-d6d9ef9eb9db req-41648b31-bf54-45c6-a476-2bdda517dfe9 service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fc2a5648-e908-42ce-8337-d6d9ef9eb9db req-41648b31-bf54-45c6-a476-2bdda517dfe9 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fc2a5648-e908-42ce-8337-d6d9ef9eb9db req-41648b31-bf54-45c6-a476-2bdda517dfe9 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-fc2a5648-e908-42ce-8337-d6d9ef9eb9db req-41648b31-bf54-45c6-a476-2bdda517dfe9 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-unplugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:10 user nova-compute[74233]: WARNING nova.compute.manager [req-fc2a5648-e908-42ce-8337-d6d9ef9eb9db req-41648b31-bf54-45c6-a476-2bdda517dfe9 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-unplugged-866b88b7-f500-46a4-8683-5e19cf96dad8 for instance with vm_state active and task_state None.
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:10 user nova-compute[74233]: INFO os_vif [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7')
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No VIF found with MAC fa:16:3e:ea:d2:6e, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:16:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:12 user nova-compute[74233]: WARNING nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-plugged-866b88b7-f500-46a4-8683-5e19cf96dad8 for instance with vm_state active and task_state None.
Oct 20 18:16:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] No waiting events found dispatching network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:12 user nova-compute[74233]: WARNING nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received unexpected event network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 for instance with vm_state building and task_state spawning.
Oct 20 18:16:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] No waiting events found dispatching network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:12 user nova-compute[74233]: WARNING nova.compute.manager [req-8960265b-1f8b-4d1b-83b8-4ef87802dac6 req-b0a4ecba-41da-424e-89ae-e9d125e7aab2 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received unexpected event network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 for instance with vm_state building and task_state spawning.
Oct 20 18:16:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:16:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:16:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Instance spawned successfully.
Oct 20 18:16:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:16:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:14 user nova-compute[74233]: INFO nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 20 18:16:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:16:14 user nova-compute[74233]: INFO nova.compute.manager [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Took 67.40 seconds to build instance.
Oct 20 18:16:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-45f28a4b-01c7-4ddb-9533-121b002c5779 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.549s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:16:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:16:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:16:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:16:23 user nova-compute[74233]: INFO nova.compute.manager [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] instance snapshotting
Oct 20 18:16:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Beginning live snapshot process
Oct 20 18:16:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiifbd80d/342809f1f0ea4f62aa640de38acad283.delta 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiifbd80d/342809f1f0ea4f62aa640de38acad283.delta 1073741824" returned: 0 in 0.054s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 18:16:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:16:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:16:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 18:16:25 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:16:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiifbd80d/342809f1f0ea4f62aa640de38acad283.delta /opt/stack/data/nova/instances/snapshots/tmpiifbd80d/342809f1f0ea4f62aa640de38acad283 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiifbd80d/342809f1f0ea4f62aa640de38acad283.delta /opt/stack/data/nova/instances/snapshots/tmpiifbd80d/342809f1f0ea4f62aa640de38acad283" returned: 0 in 0.596s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Snapshot extracted, beginning image upload
Oct 20 18:16:26 user nova-compute[74233]: INFO nova.compute.manager [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Rescuing
Oct 20 18:16:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:16:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:16:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updating instance_info_cache with network_info: [{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-changed-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing instance network info cache due to event network-changed-cd431c77-ddfd-406f-a2c5-fae2ce2523dd. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] Acquiring lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] Acquired lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG nova.network.neutron [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Refreshing network info cache for port cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance destroyed successfully.
Oct 20 18:16:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Attempting rescue
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:16:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Creating image(s)
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updated VIF entry in instance network info cache for port cd431c77-ddfd-406f-a2c5-fae2ce2523dd. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [{"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-658e9677-4710-49c5-82c5-8b723f077a5f req-a6672bef-3c5d-4e0a-9229-d4636229a72f service nova] Releasing lock "refresh_cache-947602c4-d7be-446e-87bc-b0137ac37f36" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue" returned: 0 in 0.052s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'migration_context' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.base [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<f8ba938f-246b-41d5-ab0f-30a41d148f1f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Start _get_guest_xml network_info=[{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:87:ba:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'resources' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.base [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<f8ba938f-246b-41d5-ab0f-30a41d148f1f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'numa_topology' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.base [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<f8ba938f-246b-41d5-ab0f-30a41d148f1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:16:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.base [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<f8ba938f-246b-41d5-ab0f-30a41d148f1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1831294329',display_name='tempest-ServerRescueNegativeTestJSON-server-1831294329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1831294329',id=22,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-s8wlcmb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:46Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=f8ba938f-246b-41d5-ab0f-30a41d148f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:87:ba:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:87:ba:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'pci_devices' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.objects.base [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<f8ba938f-246b-41d5-ab0f-30a41d148f1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:16:28 user nova-compute[74233]:   <uuid>f8ba938f-246b-41d5-ab0f-30a41d148f1f</uuid>
Oct 20 18:16:28 user nova-compute[74233]:   <name>instance-00000016</name>
Oct 20 18:16:28 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:16:28 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:16:28 user nova-compute[74233]:   <metadata>
Oct 20 18:16:28 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:16:28 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:16:28 user nova-compute[74233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1831294329</nova:name>
Oct 20 18:16:28 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:16:28</nova:creationTime>
Oct 20 18:16:28 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:16:28 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:16:28 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:16:28 user nova-compute[74233]:       <nova:owner>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:user uuid="15b21695cdfe4b4299fb08403ed15ddd">tempest-ServerRescueNegativeTestJSON-226182355-project-member</nova:user>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:project uuid="51e847f3ff044181bb615138361ec8da">tempest-ServerRescueNegativeTestJSON-226182355</nova:project>
Oct 20 18:16:28 user nova-compute[74233]:       </nova:owner>
Oct 20 18:16:28 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:16:28 user nova-compute[74233]:       <nova:ports>
Oct 20 18:16:28 user nova-compute[74233]:         <nova:port uuid="5ae1063f-fe60-46cb-ad70-65daa8b58493">
Oct 20 18:16:28 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:16:28 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:28 user nova-compute[74233]:       </nova:ports>
Oct 20 18:16:28 user nova-compute[74233]:     </nova:instance>
Oct 20 18:16:28 user nova-compute[74233]:   </metadata>
Oct 20 18:16:28 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:16:28 user nova-compute[74233]:     <system>
Oct 20 18:16:28 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:16:28 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:16:28 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:16:28 user nova-compute[74233]:       <entry name="serial">f8ba938f-246b-41d5-ab0f-30a41d148f1f</entry>
Oct 20 18:16:28 user nova-compute[74233]:       <entry name="uuid">f8ba938f-246b-41d5-ab0f-30a41d148f1f</entry>
Oct 20 18:16:28 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:16:28 user nova-compute[74233]:     </system>
Oct 20 18:16:28 user nova-compute[74233]:   </sysinfo>
Oct 20 18:16:28 user nova-compute[74233]:   <os>
Oct 20 18:16:28 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:16:28 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:16:28 user nova-compute[74233]:   </os>
Oct 20 18:16:28 user nova-compute[74233]:   <features>
Oct 20 18:16:28 user nova-compute[74233]:     <acpi/>
Oct 20 18:16:28 user nova-compute[74233]:     <apic/>
Oct 20 18:16:28 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:16:28 user nova-compute[74233]:   </features>
Oct 20 18:16:28 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:16:28 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:16:28 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:16:28 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:16:28 user nova-compute[74233]:   </clock>
Oct 20 18:16:28 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:16:28 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:16:28 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:16:28 user nova-compute[74233]:   </cpu>
Oct 20 18:16:28 user nova-compute[74233]:   <devices>
Oct 20 18:16:28 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:16:28 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:16:28 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue"/>
Oct 20 18:16:28 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:16:28 user nova-compute[74233]:     </disk>
Oct 20 18:16:28 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:16:28 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:16:28 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk"/>
Oct 20 18:16:28 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:16:28 user nova-compute[74233]:     </disk>
Oct 20 18:16:28 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:28 user nova-compute[74233]:       <mac address="fa:16:3e:87:ba:a3"/>
Oct 20 18:16:28 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:28 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:28 user nova-compute[74233]:       <target dev="tap5ae1063f-fe"/>
Oct 20 18:16:28 user nova-compute[74233]:     </interface>
Oct 20 18:16:28 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:16:28 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/console.log" append="off"/>
Oct 20 18:16:28 user nova-compute[74233]:     </serial>
Oct 20 18:16:28 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:16:28 user nova-compute[74233]:     <video>
Oct 20 18:16:28 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:28 user nova-compute[74233]:     </video>
Oct 20 18:16:28 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:16:28 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:16:28 user nova-compute[74233]:     </rng>
Oct 20 18:16:28 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:16:28 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:16:28 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:16:28 user nova-compute[74233]:     </memballoon>
Oct 20 18:16:28 user nova-compute[74233]:   </devices>
Oct 20 18:16:28 user nova-compute[74233]: </domain>
Oct 20 18:16:28 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:16:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance destroyed successfully.
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:87:ba:a3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:16:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Snapshot image upload complete
Oct 20 18:16:28 user nova-compute[74233]: INFO nova.compute.manager [None req-7a2e9e6c-8311-4765-aa0d-d2d79597795a tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Took 5.73 seconds to snapshot the instance on the hypervisor.
Oct 20 18:16:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-unplugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-unplugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:29 user nova-compute[74233]: WARNING nova.compute.manager [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-unplugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state active and task_state rescuing.
Oct 20 18:16:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:29 user nova-compute[74233]: WARNING nova.compute.manager [req-249db50c-7290-4c09-8a74-67b8795db196 req-a75050ad-4f46-437d-8500-b3595917d200 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state active and task_state rescuing.
Oct 20 18:16:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Waiting for libvirt event about the detach of device tap866b88b7-f5 with device alias net1 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 is timed out.
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1d:e7:16"/><model type="virtio"/><mtu size="1442"/><target dev="tap866b88b7-f5"/></interface> {{(pid=74233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:1d:e7:16"/><model type="virtio"/><mtu size="1442"/><target dev="tap866b88b7-f5"/></interface>not found in domain: <domain type='kvm' id='20'>
Oct 20 18:16:30 user nova-compute[74233]:   <name>instance-00000012</name>
Oct 20 18:16:30 user nova-compute[74233]:   <uuid>e0124740-defc-4aff-9a68-9c3604f1d3c9</uuid>
Oct 20 18:16:30 user nova-compute[74233]:   <metadata>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:16:30 user nova-compute[74233]:   <nova:package version="0.0.0"/>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:name>tempest-device-tagging-server-1201646160</nova:name>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:creationTime>2023-10-20 18:15:02</nova:creationTime>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:flavor name="m1.tiny">
Oct 20 18:16:30 user nova-compute[74233]:     <nova:memory>512</nova:memory>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:disk>1</nova:disk>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:swap>0</nova:swap>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:vcpus>1</nova:vcpus>
Oct 20 18:16:30 user nova-compute[74233]:   </nova:flavor>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:owner>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:user uuid="1bc0d56bcb4244c4a8f15522ca7fc78a">tempest-TaggedAttachmentsTest-1226898318-project-member</nova:user>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:project uuid="241507110dbc42719d74f9c1c8795d7f">tempest-TaggedAttachmentsTest-1226898318</nova:project>
Oct 20 18:16:30 user nova-compute[74233]:   </nova:owner>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:ports>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:port uuid="e1d6651b-0fe2-47f6-ba08-7d8db7c28342">
Oct 20 18:16:30 user nova-compute[74233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:16:30 user nova-compute[74233]:     </nova:port>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:port uuid="866b88b7-f500-46a4-8683-5e19cf96dad8">
Oct 20 18:16:30 user nova-compute[74233]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Oct 20 18:16:30 user nova-compute[74233]:     </nova:port>
Oct 20 18:16:30 user nova-compute[74233]:   </nova:ports>
Oct 20 18:16:30 user nova-compute[74233]: </nova:instance>
Oct 20 18:16:30 user nova-compute[74233]:   </metadata>
Oct 20 18:16:30 user nova-compute[74233]:   <memory unit='KiB'>524288</memory>
Oct 20 18:16:30 user nova-compute[74233]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 18:16:30 user nova-compute[74233]:   <vcpu placement='static'>1</vcpu>
Oct 20 18:16:30 user nova-compute[74233]:   <resource>
Oct 20 18:16:30 user nova-compute[74233]:     <partition>/machine</partition>
Oct 20 18:16:30 user nova-compute[74233]:   </resource>
Oct 20 18:16:30 user nova-compute[74233]:   <sysinfo type='smbios'>
Oct 20 18:16:30 user nova-compute[74233]:     <system>
Oct 20 18:16:30 user nova-compute[74233]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 18:16:30 user nova-compute[74233]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 18:16:30 user nova-compute[74233]:       <entry name='version'>0.0.0</entry>
Oct 20 18:16:30 user nova-compute[74233]:       <entry name='serial'>e0124740-defc-4aff-9a68-9c3604f1d3c9</entry>
Oct 20 18:16:30 user nova-compute[74233]:       <entry name='uuid'>e0124740-defc-4aff-9a68-9c3604f1d3c9</entry>
Oct 20 18:16:30 user nova-compute[74233]:       <entry name='family'>Virtual Machine</entry>
Oct 20 18:16:30 user nova-compute[74233]:     </system>
Oct 20 18:16:30 user nova-compute[74233]:   </sysinfo>
Oct 20 18:16:30 user nova-compute[74233]:   <os>
Oct 20 18:16:30 user nova-compute[74233]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 18:16:30 user nova-compute[74233]:     <boot dev='hd'/>
Oct 20 18:16:30 user nova-compute[74233]:     <smbios mode='sysinfo'/>
Oct 20 18:16:30 user nova-compute[74233]:   </os>
Oct 20 18:16:30 user nova-compute[74233]:   <features>
Oct 20 18:16:30 user nova-compute[74233]:     <acpi/>
Oct 20 18:16:30 user nova-compute[74233]:     <apic/>
Oct 20 18:16:30 user nova-compute[74233]:     <vmcoreinfo state='on'/>
Oct 20 18:16:30 user nova-compute[74233]:   </features>
Oct 20 18:16:30 user nova-compute[74233]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 18:16:30 user nova-compute[74233]:     <model fallback='forbid'>Nehalem</model>
Oct 20 18:16:30 user nova-compute[74233]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 18:16:30 user nova-compute[74233]:     <feature policy='require' name='vme'/>
Oct 20 18:16:30 user nova-compute[74233]:     <feature policy='require' name='x2apic'/>
Oct 20 18:16:30 user nova-compute[74233]:     <feature policy='require' name='hypervisor'/>
Oct 20 18:16:30 user nova-compute[74233]:   </cpu>
Oct 20 18:16:30 user nova-compute[74233]:   <clock offset='utc'>
Oct 20 18:16:30 user nova-compute[74233]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 18:16:30 user nova-compute[74233]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 18:16:30 user nova-compute[74233]:     <timer name='hpet' present='no'/>
Oct 20 18:16:30 user nova-compute[74233]:   </clock>
Oct 20 18:16:30 user nova-compute[74233]:   <on_poweroff>destroy</on_poweroff>
Oct 20 18:16:30 user nova-compute[74233]:   <on_reboot>restart</on_reboot>
Oct 20 18:16:30 user nova-compute[74233]:   <on_crash>destroy</on_crash>
Oct 20 18:16:30 user nova-compute[74233]:   <devices>
Oct 20 18:16:30 user nova-compute[74233]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 18:16:30 user nova-compute[74233]:     <disk type='file' device='disk'>
Oct 20 18:16:30 user nova-compute[74233]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 18:16:30 user nova-compute[74233]:       <source file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk' index='2'/>
Oct 20 18:16:30 user nova-compute[74233]:       <backingStore type='file' index='3'>
Oct 20 18:16:30 user nova-compute[74233]:         <format type='raw'/>
Oct 20 18:16:30 user nova-compute[74233]:         <source file='/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48'/>
Oct 20 18:16:30 user nova-compute[74233]:         <backingStore/>
Oct 20 18:16:30 user nova-compute[74233]:       </backingStore>
Oct 20 18:16:30 user nova-compute[74233]:       <target dev='vda' bus='virtio'/>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='virtio-disk0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </disk>
Oct 20 18:16:30 user nova-compute[74233]:     <disk type='file' device='cdrom'>
Oct 20 18:16:30 user nova-compute[74233]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 18:16:30 user nova-compute[74233]:       <source file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk.config' index='1'/>
Oct 20 18:16:30 user nova-compute[74233]:       <backingStore/>
Oct 20 18:16:30 user nova-compute[74233]:       <target dev='hda' bus='ide'/>
Oct 20 18:16:30 user nova-compute[74233]:       <readonly/>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='ide0-0-0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </disk>
Oct 20 18:16:30 user nova-compute[74233]:     <controller type='usb' index='0' model='none'>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='usb'/>
Oct 20 18:16:30 user nova-compute[74233]:     </controller>
Oct 20 18:16:30 user nova-compute[74233]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='pci.0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </controller>
Oct 20 18:16:30 user nova-compute[74233]:     <controller type='ide' index='0'>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='ide'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 18:16:30 user nova-compute[74233]:     </controller>
Oct 20 18:16:30 user nova-compute[74233]:     <interface type='ethernet'>
Oct 20 18:16:30 user nova-compute[74233]:       <mac address='fa:16:3e:77:e9:45'/>
Oct 20 18:16:30 user nova-compute[74233]:       <target dev='tape1d6651b-0f'/>
Oct 20 18:16:30 user nova-compute[74233]:       <model type='virtio'/>
Oct 20 18:16:30 user nova-compute[74233]:       <mtu size='1442'/>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='net0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </interface>
Oct 20 18:16:30 user nova-compute[74233]:     <serial type='pty'>
Oct 20 18:16:30 user nova-compute[74233]:       <source path='/dev/pts/3'/>
Oct 20 18:16:30 user nova-compute[74233]:       <log file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/console.log' append='off'/>
Oct 20 18:16:30 user nova-compute[74233]:       <target type='isa-serial' port='0'>
Oct 20 18:16:30 user nova-compute[74233]:         <model name='isa-serial'/>
Oct 20 18:16:30 user nova-compute[74233]:       </target>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='serial0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </serial>
Oct 20 18:16:30 user nova-compute[74233]:     <console type='pty' tty='/dev/pts/3'>
Oct 20 18:16:30 user nova-compute[74233]:       <source path='/dev/pts/3'/>
Oct 20 18:16:30 user nova-compute[74233]:       <log file='/opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/console.log' append='off'/>
Oct 20 18:16:30 user nova-compute[74233]:       <target type='serial' port='0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='serial0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </console>
Oct 20 18:16:30 user nova-compute[74233]:     <input type='mouse' bus='ps2'>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='input0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </input>
Oct 20 18:16:30 user nova-compute[74233]:     <input type='keyboard' bus='ps2'>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='input1'/>
Oct 20 18:16:30 user nova-compute[74233]:     </input>
Oct 20 18:16:30 user nova-compute[74233]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Oct 20 18:16:30 user nova-compute[74233]:       <listen type='address' address='0.0.0.0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </graphics>
Oct 20 18:16:30 user nova-compute[74233]:     <audio id='1' type='none'/>
Oct 20 18:16:30 user nova-compute[74233]:     <video>
Oct 20 18:16:30 user nova-compute[74233]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='video0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </video>
Oct 20 18:16:30 user nova-compute[74233]:     <memballoon model='virtio'>
Oct 20 18:16:30 user nova-compute[74233]:       <stats period='10'/>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='balloon0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </memballoon>
Oct 20 18:16:30 user nova-compute[74233]:     <rng model='virtio'>
Oct 20 18:16:30 user nova-compute[74233]:       <backend model='random'>/dev/urandom</backend>
Oct 20 18:16:30 user nova-compute[74233]:       <alias name='rng0'/>
Oct 20 18:16:30 user nova-compute[74233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 18:16:30 user nova-compute[74233]:     </rng>
Oct 20 18:16:30 user nova-compute[74233]:   </devices>
Oct 20 18:16:30 user nova-compute[74233]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 18:16:30 user nova-compute[74233]:     <label>libvirt-e0124740-defc-4aff-9a68-9c3604f1d3c9</label>
Oct 20 18:16:30 user nova-compute[74233]:     <imagelabel>libvirt-e0124740-defc-4aff-9a68-9c3604f1d3c9</imagelabel>
Oct 20 18:16:30 user nova-compute[74233]:   </seclabel>
Oct 20 18:16:30 user nova-compute[74233]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 18:16:30 user nova-compute[74233]:     <label>+64055:+108</label>
Oct 20 18:16:30 user nova-compute[74233]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 18:16:30 user nova-compute[74233]:   </seclabel>
Oct 20 18:16:30 user nova-compute[74233]: </domain>
Oct 20 18:16:30 user nova-compute[74233]:  {{(pid=74233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 18:16:30 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully detached device tap866b88b7-f5 from instance e0124740-defc-4aff-9a68-9c3604f1d3c9 from the live domain config.
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "866b88b7-f500-46a4-8683-5e19cf96dad8", "address": "fa:16:3e:1d:e7:16", "network": {"id": "24a06695-aef0-4d17-9e10-f19bb676499d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-779261391", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b88b7-f5", "ovs_interfaceid": "866b88b7-f500-46a4-8683-5e19cf96dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG os_vif [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "947602c4-d7be-446e-87bc-b0137ac37f36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap866b88b7-f5, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:30 user nova-compute[74233]: INFO nova.compute.manager [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Terminating instance
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11db6094-c51d-43fa-92da-1e3ce12a1c26) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: INFO os_vif [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e7:16,bridge_name='br-int',has_traffic_filtering=True,id=866b88b7-f500-46a4-8683-5e19cf96dad8,network=Network(24a06695-aef0-4d17-9e10-f19bb676499d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b88b7-f5')
Oct 20 18:16:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:16:30 user nova-compute[74233]:   <nova:package version="0.0.0"/>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:name>tempest-device-tagging-server-1201646160</nova:name>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:creationTime>2023-10-20 18:16:30</nova:creationTime>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:flavor name="m1.tiny">
Oct 20 18:16:30 user nova-compute[74233]:     <nova:memory>512</nova:memory>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:disk>1</nova:disk>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:swap>0</nova:swap>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:vcpus>1</nova:vcpus>
Oct 20 18:16:30 user nova-compute[74233]:   </nova:flavor>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:owner>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:user uuid="1bc0d56bcb4244c4a8f15522ca7fc78a">tempest-TaggedAttachmentsTest-1226898318-project-member</nova:user>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:project uuid="241507110dbc42719d74f9c1c8795d7f">tempest-TaggedAttachmentsTest-1226898318</nova:project>
Oct 20 18:16:30 user nova-compute[74233]:   </nova:owner>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:16:30 user nova-compute[74233]:   <nova:ports>
Oct 20 18:16:30 user nova-compute[74233]:     <nova:port uuid="e1d6651b-0fe2-47f6-ba08-7d8db7c28342">
Oct 20 18:16:30 user nova-compute[74233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 18:16:30 user nova-compute[74233]:     </nova:port>
Oct 20 18:16:30 user nova-compute[74233]:   </nova:ports>
Oct 20 18:16:30 user nova-compute[74233]: </nova:instance>
Oct 20 18:16:30 user nova-compute[74233]:  {{(pid=74233) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-6fbb0f5d-c301-4fff-8b5e-7083e727b357 req-7c7da9c6-3cc9-4675-ad71-3341b88d59f4 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6fbb0f5d-c301-4fff-8b5e-7083e727b357 req-7c7da9c6-3cc9-4675-ad71-3341b88d59f4 service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6fbb0f5d-c301-4fff-8b5e-7083e727b357 req-7c7da9c6-3cc9-4675-ad71-3341b88d59f4 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6fbb0f5d-c301-4fff-8b5e-7083e727b357 req-7c7da9c6-3cc9-4675-ad71-3341b88d59f4 service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-6fbb0f5d-c301-4fff-8b5e-7083e727b357 req-7c7da9c6-3cc9-4675-ad71-3341b88d59f4 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-6fbb0f5d-c301-4fff-8b5e-7083e727b357 req-7c7da9c6-3cc9-4675-ad71-3341b88d59f4 service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquired lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: WARNING nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state active and task_state rescuing.
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: WARNING nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state active and task_state rescuing.
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: WARNING nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-cd431c77-ddfd-406f-a2c5-fae2ce2523dd for instance with vm_state active and task_state deleting.
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-89a2575d-107e-4825-84d4-1dac010e112a for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: WARNING nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-89a2575d-107e-4825-84d4-1dac010e112a for instance with vm_state active and task_state deleting.
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:31 user nova-compute[74233]: WARNING nova.compute.manager [req-ae010591-128f-4a9f-b19b-72f870224f37 req-0d809b9e-69ee-48a6-b169-77a76a944dfe service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-05589e7f-2a3d-4e36-b55b-ad3f3b07184b for instance with vm_state active and task_state deleting.
Oct 20 18:16:31 user nova-compute[74233]: INFO nova.network.neutron [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Port 866b88b7-f500-46a4-8683-5e19cf96dad8 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 20 18:16:31 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [{"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Releasing lock "refresh_cache-e0124740-defc-4aff-9a68-9c3604f1d3c9" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:16:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d62dd816-5532-411a-846f-81c3da8865bd tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "interface-e0124740-defc-4aff-9a68-9c3604f1d3c9-866b88b7-f500-46a4-8683-5e19cf96dad8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.103s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Instance destroyed successfully.
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.objects.instance [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lazy-loading 'resources' on Instance uuid 947602c4-d7be-446e-87bc-b0137ac37f36 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd431c77-dd, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d86c06f-bc21-43ee-9a4e-b49ff4e9ab6f) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=cd431c77-ddfd-406f-a2c5-fae2ce2523dd,network=Network(6af90536-c181-4f05-a503-7e2842882f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd431c77-dd')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca61b8dd-43, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0efd909-21cb-410d-8f4b-74af303cdd12) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4ed20bdf-342c-4719-b6e9-8213fc00756e tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=ca61b8dd-439a-48ef-9be7-73c94df5d3ec,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca61b8dd-43')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89a2575d-10, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df14d824-7261-41f7-9abe-642b1c04a251) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8d:16,bridge_name='br-int',has_traffic_filtering=True,id=89a2575d-107e-4825-84d4-1dac010e112a,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89a2575d-10')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d5b7c5-29, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a22b2bcc-7f9c-4666-9602-1d5eb4fb2b0c) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:fc,bridge_name='br-int',has_traffic_filtering=True,id=d4d5b7c5-29fc-4cd6-a355-808cf6f24765,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5b7c5-29')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4048936f-0e, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09e93e60-c5ba-4a6b-972a-d01d656895d1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:57:ca,bridge_name='br-int',has_traffic_filtering=True,id=4048936f-0e3b-44c2-a850-c31201c29593,network=Network(6a4e630c-b1d5-47f2-b731-5e45a26a601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4048936f-0e')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05589e7f-2a, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a27c228f-0a70-4478-9ab1-cd85105f7b4b) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:28:5e,bridge_name='br-int',has_traffic_filtering=True,id=05589e7f-2a3d-4e36-b55b-ad3f3b07184b,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05589e7f-2a')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2011573578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2011573578',id=16,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2iTBCfQOGI2emv8iG/HzKgGXDu7ynQbNkhldWRbjCg3lZA7cFd8PzzsxCSyGhCVuT6EW3wzMVMFVXd8Etw5/6djwYzDK5U7BqkVIcB3NhUN6v42lM+6aIudcbitaPEwQ==',key_name='tempest-keypair-628787413',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0effbd2489472d8c0f0661b4349e69',ramdisk_id='',reservation_id='r-ytdv4as9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1557453215',owner_user_name='tempest-TaggedBootDevicesTest-1557453215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4faad54e08c645dc89cc14332c6b6838',uuid=947602c4-d7be-446e-87bc-b0137ac37f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converting VIF {"id": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "address": "fa:16:3e:00:75:07", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e9e9de-30", "ovs_interfaceid": "b7e9e9de-30cd-4372-a8c8-6ec480fc3520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7e9e9de-30, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ea04e4d-228b-4b3d-82c3-81cd3be37702) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:32 user nova-compute[74233]: INFO os_vif [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:75:07,bridge_name='br-int',has_traffic_filtering=True,id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520,network=Network(8080ec70-e9a9-40e0-be00-e7806aac307e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e9e9de-30')
Oct 20 18:16:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovrKGXSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614a170-d853-49d3-b8de-fd9fab32fabe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:16:32 user nova-compute[74233]: No targets found.
Oct 20 18:16:32 user nova-compute[74233]: iSNS:
Oct 20 18:16:32 user nova-compute[74233]: No targets found.
Oct 20 18:16:32 user nova-compute[74233]: STATIC:
Oct 20 18:16:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176
Oct 20 18:16:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d
Oct 20 18:16:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1
Oct 20 18:16:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:16:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148
Oct 20 18:16:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:16:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:32 user nova-compute[74233]: FIRMWARE:
Oct 20 18:16:32 user nova-compute[74233]: No targets found.
Oct 20 18:16:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:16:32 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:16:32 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b6b9a1-6574-493c-b824-1812edc6e7f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd767002-f3f8-492c-a950-3cb0a994011b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970422ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148'): ({'sdg'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Removing single pathed devices sdg {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57d9aa8-c09a-44e3-987b-8e03714cac95]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91211f3b-ed39-4420-8534-32a4ff455bef]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Flushing IO for device /dev/sdg {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e99e8-4b02-4fe8-aa17-2288f5b54a95]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:16:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02d82bc-a18d-4833-aa78-8ba4e109c900]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b3df94-bbab-4e08-8b65-b70298fb0972]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-deleted-866b88b7-f500-46a4-8683-5e19cf96dad8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: WARNING nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-ca61b8dd-439a-48ef-9be7-73c94df5d3ec for instance with vm_state active and task_state deleting.
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: WARNING nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 for instance with vm_state active and task_state deleting.
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-4048936f-0e3b-44c2-a850-c31201c29593 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: WARNING nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-4048936f-0e3b-44c2-a850-c31201c29593 for instance with vm_state active and task_state deleting.
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-unplugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-unplugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Acquiring lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] Lock "947602c4-d7be-446e-87bc-b0137ac37f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] No waiting events found dispatching network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:33 user nova-compute[74233]: WARNING nova.compute.manager [req-38ab410d-ee35-4186-ab53-352abec4cf4a req-76bba675-7d8a-455a-b72a-a13bac7f4aef service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received unexpected event network-vif-plugged-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 for instance with vm_state active and task_state deleting.
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6268b776-e252-4b11-8f70-8e681df7ad85]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260]
Oct 20 18:16:33 user nova-compute[74233]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199c2bcc-8524-4202-a329-09d0ad3c1148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba29791-b22e-4652-9d18-dada1b3e9e59]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== disconnect_volume: return (461ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZVeynXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6177d6de-c7fb-45d0-8d3a-4cb7be7b9e45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:16:33 user nova-compute[74233]: No targets found.
Oct 20 18:16:33 user nova-compute[74233]: iSNS:
Oct 20 18:16:33 user nova-compute[74233]: No targets found.
Oct 20 18:16:33 user nova-compute[74233]: STATIC:
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: FIRMWARE:
Oct 20 18:16:33 user nova-compute[74233]: No targets found.
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:16:33 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:16:33 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62d4d15-7ddd-4d37-9939-731b0e6cbbab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa6938a-e759-453f-bca6-3a823ee3d58c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b252548-9f07-4724-9c75-8d2380752d29]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c7a7c6-480f-4d95-b5cb-81710f71a75f]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb880e0-a199-4ba0-bc05-917b5d9ea79d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2598a649-8c5e-42cf-a87c-7a62fb0660c8]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002ca6e-5009-42cc-8ed8-cf5a60101986]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc7148-4643-4dce-b5aa-df9c27ddd6c8]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260]
Oct 20 18:16:33 user nova-compute[74233]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40148486-b5b3-489d-934c-21f389d51176 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6722392-3d50-45e5-bb08-c765f1ae8277]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== disconnect_volume: return (321ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saPWuRTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb93847-d486-4788-939b-e4ebb5f397da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:16:33 user nova-compute[74233]: No targets found.
Oct 20 18:16:33 user nova-compute[74233]: iSNS:
Oct 20 18:16:33 user nova-compute[74233]: No targets found.
Oct 20 18:16:33 user nova-compute[74233]: STATIC:
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:16:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:16:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:16:33 user nova-compute[74233]: FIRMWARE:
Oct 20 18:16:33 user nova-compute[74233]: No targets found.
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:16:33 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:16:33 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c228bd-d204-4066-bcdd-81d7fe157e6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa4b42-bd92-4341-8641-640a0e31f1f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d'): ({'sdf'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Removing single pathed devices sdf {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4917d1-651c-428e-9e2b-adb2670b8e9d]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7a1e4-47fc-4215-876f-d7855ae1a61d]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Flushing IO for device /dev/sdf {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[080d39c8-a304-4d82-9890-f37c908473d5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74586e17-bfc5-4669-9b5c-8ff074cebb30]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4790056-c465-4624-9288-e9a3a797557a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6b7558-6233-4008-a545-b5861e76b888]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260]
Oct 20 18:16:33 user nova-compute[74233]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'flavor' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e328c698-0f86-40c4-b403-c7e1c965d20d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43409874-dc17-4bb1-9f11-df78a1594c86]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] <== disconnect_volume: return (345ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:16:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Deleting instance files /opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36_del
Oct 20 18:16:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Deletion of /opt/stack/data/nova/instances/947602c4-d7be-446e-87bc-b0137ac37f36_del complete
Oct 20 18:16:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:16:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:16:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Creating image(s)
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Ensure instance console log exists: /opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Start _get_guest_xml network_info=[{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '4d1bfe83-1e9e-4118-92c9-a8d778fa2691', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kToUDKwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c', 'attached_at': '', 'detached_at': '', 'volume_id': '6bab5f0b-1130-4a2f-b0f6-f32751698984', 'serial': '6bab5f0b-1130-4a2f-b0f6-f32751698984'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '29629c15-4b4d-4ac1-b93a-f9308f26372d', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXNTeZfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c', 'attached_at': '', 'detached_at': '', 'volume_id': '8b921a80-683b-49f8-8832-43dc5ab778c2', 'serial': '8b921a80-683b-49f8-8832-43dc5ab778c2'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '121363a0-12c7-45ff-8a67-473d3fa6e751', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmMAneyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c', 'attached_at': '', 'detached_at': '', 'volume_id': '039588a1-7d9f-4513-80a3-ec1074afd743', 'serial': '039588a1-7d9f-4513-80a3-ec1074afd743'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:16:34 user nova-compute[74233]: INFO nova.compute.manager [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Took 3.61 seconds to destroy the instance on the hypervisor.
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:16:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kToUDKwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:34 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b6850-61ad-4a1c-b12d-62f25d9bb1b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:16:34 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:34 user nova-compute[74233]: INFO nova.compute.manager [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Attaching volume 19627e31-7ae4-40ce-b918-f135c4fedae0 to /dev/vdb
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44bf0ae-1e71-42b4-b77c-1216fd2bc061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984] added
Oct 20 18:16:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4345af-7684-4c02-9725-6cf2394c2c37]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f06361-1431-4871-8caa-44add14a3606]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kToUDKwS {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.utils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kToUDKwS" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c39862-f442-467a-b0c7-df83beaede0e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kToUDKwS'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6535219-d269-4c07-bba7-5ff651ba444f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79467031-e2e6-4ee0-b2ee-e1dd31cb3c32]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d01ec-7b54-4c4f-9db7-7b135e946106]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09cbe80-406f-4fd2-b47b-323fa8c5f941]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f32864-076c-486f-9b33-af20e6a778d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c97419-eaf6-4250-883c-d45811d752ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:16:34 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e97f50-0efa-4e39-9412-cb44df2eb4fa]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d46109-fee3-4e50-941c-bd3045a164f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260]
Oct 20 18:16:34 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.utils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating existing volume attachment record: 5044ac00-e3cd-470d-92cd-3dfa06f313c7 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6b74a2-63d0-4b95-b255-f7cd797e61f6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87913f4-f3e9-40b4-9e14-9b8aee70444a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ac469-03de-4059-850c-cc8b7a34e662]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kToUDKwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26438356637363435', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438356637363435', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXNTeZfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:35 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:35 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:35 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5b0b5-64d9-4a3a-b268-767d4787ef9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:16:35 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.069s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a874c57-2158-40ca-a3fc-fb0b36b776c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2] added
Oct 20 18:16:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ae7a6-701b-4657-8a14-222a61fc9332]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f16acb-a743-4e4f-9e83-57e8bcaa0f1b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXNTeZfn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXNTeZfn" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff479b-f2af-48a1-b226-1d6a26bf5b02]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXNTeZfn'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[472995e0-c90b-4084-96fb-70bafc6f3ae4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bb7d3f-7e61-4f8f-946f-703bd539a9bf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27664a4e-e938-4bf0-94d7-b1253e930d88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260]
Oct 20 18:16:35 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acef77a-a514-45ba-a1b3-6f9e9aea81f3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ce195-ec2b-4d4d-9aaf-fc54a7dacdca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6700890e-a6e6-4b7a-91df-0ab46fe00d23 req-9d265da6-3b00-480b-8bd4-4965663d3a3d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-deleted-b7e9e9de-30cd-4372-a8c8-6ec480fc3520 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:35 user nova-compute[74233]: INFO nova.compute.manager [req-6700890e-a6e6-4b7a-91df-0ab46fe00d23 req-9d265da6-3b00-480b-8bd4-4965663d3a3d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Neutron deleted interface b7e9e9de-30cd-4372-a8c8-6ec480fc3520; detaching it from the instance and deleting it from the info cache
Oct 20 18:16:35 user nova-compute[74233]: DEBUG nova.network.neutron [req-6700890e-a6e6-4b7a-91df-0ab46fe00d23 req-9d265da6-3b00-480b-8bd4-4965663d3a3d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [{"id": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "address": "fa:16:3e:57:6d:60", "network": {"id": "6af90536-c181-4f05-a503-7e2842882f83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-961155908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd431c77-dd", "ovs_interfaceid": "cd431c77-ddfd-406f-a2c5-fae2ce2523dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "address": "fa:16:3e:b1:ee:2e", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca61b8dd-43", "ovs_interfaceid": "ca61b8dd-439a-48ef-9be7-73c94df5d3ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89a2575d-107e-4825-84d4-1dac010e112a", "address": "fa:16:3e:08:8d:16", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a2575d-10", "ovs_interfaceid": "89a2575d-107e-4825-84d4-1dac010e112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "address": "fa:16:3e:51:9a:fc", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5b7c5-29", "ovs_interfaceid": "d4d5b7c5-29fc-4cd6-a355-808cf6f24765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4048936f-0e3b-44c2-a850-c31201c29593", "address": "fa:16:3e:12:57:ca", "network": {"id": "6a4e630c-b1d5-47f2-b731-5e45a26a601d", "bridge": "br-int", "label": "tempest-device-tagging-net1-706154385", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4048936f-0e", "ovs_interfaceid": "4048936f-0e3b-44c2-a850-c31201c29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "address": "fa:16:3e:d8:28:5e", "network": {"id": "8080ec70-e9a9-40e0-be00-e7806aac307e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1111178596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1a0effbd2489472d8c0f0661b4349e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05589e7f-2a", "ovs_interfaceid": "05589e7f-2a3d-4e36-b55b-ad3f3b07184b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7fb0c6-0044-40d9-896b-9409a7b939f7]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6700890e-a6e6-4b7a-91df-0ab46fe00d23 req-9d265da6-3b00-480b-8bd4-4965663d3a3d service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Detach interface failed, port_id=b7e9e9de-30cd-4372-a8c8-6ec480fc3520, reason: Instance 947602c4-d7be-446e-87bc-b0137ac37f36 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXNTeZfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23236306236636262', 'path': '/dev/sdf'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236306236636262', 'path': '/dev/sdf'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmMAneyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:36 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:16:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a35b043-657c-4272-a251-6f282790b6e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:16:36 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff72033-f4ba-4456-9a9f-e2220eb2db9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743] added
Oct 20 18:16:37 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a4129-9db4-46e9-a96c-87872435bc96]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ccc350-dfa6-44b1-8c2e-6b81091a12ab]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hmMAneyo {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hmMAneyo" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4d4232-ff1c-4c82-8cb0-5fb457869441]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hmMAneyo'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc039a-3073-49bd-b60a-b287b61750ff]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63c5920-d6c3-425c-9486-2526da2f714b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c254c7-3eaf-44e2-be1e-38c9356fa407]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260]
Oct 20 18:16:37 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:37 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d019fb0-b901-42b6-8818-a1cc1ea99cf6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4423b-9731-49ce-914a-3f3c36cc020c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:37 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e39d08d-db2a-4ee3-ba01-62f02caf2133]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmMAneyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:16:37 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Took 3.70 seconds to deallocate network for instance.
Oct 20 18:16:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-376e42e1-2a01-4d08-9b42-364c35d0596d req-6b2c72bb-159e-45a4-9ffa-7ab66399915f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-deleted-d4d5b7c5-29fc-4cd6-a355-808cf6f24765 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-376e42e1-2a01-4d08-9b42-364c35d0596d req-6b2c72bb-159e-45a4-9ffa-7ab66399915f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-deleted-05589e7f-2a3d-4e36-b55b-ad3f3b07184b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-376e42e1-2a01-4d08-9b42-364c35d0596d req-6b2c72bb-159e-45a4-9ffa-7ab66399915f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-deleted-cd431c77-ddfd-406f-a2c5-fae2ce2523dd {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-376e42e1-2a01-4d08-9b42-364c35d0596d req-6b2c72bb-159e-45a4-9ffa-7ab66399915f service nova] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Received event network-vif-deleted-4048936f-0e3b-44c2-a850-c31201c29593 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26662316335376164', 'path': '/dev/sdg'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662316335376164', 'path': '/dev/sdg'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lazy-loading 'pci_devices' on Instance uuid cbc2e0b7-b29a-400e-8a29-2d6bd88a511c {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:16:38 user nova-compute[74233]:   <uuid>cbc2e0b7-b29a-400e-8a29-2d6bd88a511c</uuid>
Oct 20 18:16:38 user nova-compute[74233]:   <name>instance-00000017</name>
Oct 20 18:16:38 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:16:38 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:16:38 user nova-compute[74233]:   <metadata>
Oct 20 18:16:38 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:16:38 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:16:38 user nova-compute[74233]:       <nova:name>tempest-device-tagging-server-455981786</nova:name>
Oct 20 18:16:38 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:16:34</nova:creationTime>
Oct 20 18:16:38 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:16:38 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:16:38 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:16:38 user nova-compute[74233]:       <nova:owner>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:user uuid="04da36886f4a414cb75546d7fb188795">tempest-TaggedBootDevicesTest_v242-1388277468-project-member</nova:user>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:project uuid="79cfb373bc1442729225e42dd93218c1">tempest-TaggedBootDevicesTest_v242-1388277468</nova:project>
Oct 20 18:16:38 user nova-compute[74233]:       </nova:owner>
Oct 20 18:16:38 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:16:38 user nova-compute[74233]:       <nova:ports>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="e0b50651-f865-4c34-8080-f3eaaa4d35ed">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="3bdc7d75-307c-4da7-bd53-1ea965385267">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="482ffd97-c560-48db-9a6d-e31105c795d8">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="3fa496b2-da99-4d66-aff9-7300f3e53104">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="b70b5aab-5ae7-4ab2-a185-33e1b70cc291">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.1.1.58" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="ea450dd9-f552-4ade-9342-7e288f6d4ad5">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:         <nova:port uuid="86d00573-f6f4-4818-af54-87e252612426">
Oct 20 18:16:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 18:16:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:16:38 user nova-compute[74233]:       </nova:ports>
Oct 20 18:16:38 user nova-compute[74233]:     </nova:instance>
Oct 20 18:16:38 user nova-compute[74233]:   </metadata>
Oct 20 18:16:38 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:16:38 user nova-compute[74233]:     <system>
Oct 20 18:16:38 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:16:38 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:16:38 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:16:38 user nova-compute[74233]:       <entry name="serial">cbc2e0b7-b29a-400e-8a29-2d6bd88a511c</entry>
Oct 20 18:16:38 user nova-compute[74233]:       <entry name="uuid">cbc2e0b7-b29a-400e-8a29-2d6bd88a511c</entry>
Oct 20 18:16:38 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:16:38 user nova-compute[74233]:     </system>
Oct 20 18:16:38 user nova-compute[74233]:   </sysinfo>
Oct 20 18:16:38 user nova-compute[74233]:   <os>
Oct 20 18:16:38 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:16:38 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:16:38 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:16:38 user nova-compute[74233]:   </os>
Oct 20 18:16:38 user nova-compute[74233]:   <features>
Oct 20 18:16:38 user nova-compute[74233]:     <acpi/>
Oct 20 18:16:38 user nova-compute[74233]:     <apic/>
Oct 20 18:16:38 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:16:38 user nova-compute[74233]:   </features>
Oct 20 18:16:38 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:16:38 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:16:38 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:16:38 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:16:38 user nova-compute[74233]:   </clock>
Oct 20 18:16:38 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:16:38 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:16:38 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:16:38 user nova-compute[74233]:   </cpu>
Oct 20 18:16:38 user nova-compute[74233]:   <devices>
Oct 20 18:16:38 user nova-compute[74233]:     <disk type="file" device="cdrom">
Oct 20 18:16:38 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 18:16:38 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c/disk.config"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="hda" bus="ide"/>
Oct 20 18:16:38 user nova-compute[74233]:     </disk>
Oct 20 18:16:38 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:16:38 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:16:38 user nova-compute[74233]:       <source dev="/dev/sde"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <serial>6bab5f0b-1130-4a2f-b0f6-f32751698984</serial>
Oct 20 18:16:38 user nova-compute[74233]:     </disk>
Oct 20 18:16:38 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:16:38 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:16:38 user nova-compute[74233]:       <source dev="/dev/sdf"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <serial>8b921a80-683b-49f8-8832-43dc5ab778c2</serial>
Oct 20 18:16:38 user nova-compute[74233]:     </disk>
Oct 20 18:16:38 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:16:38 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:16:38 user nova-compute[74233]:       <source dev="/dev/sdg"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="vdc" bus="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <serial>039588a1-7d9f-4513-80a3-ec1074afd743</serial>
Oct 20 18:16:38 user nova-compute[74233]:     </disk>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:33:9b:d6"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tape0b50651-f8"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:42:35:8c"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tap3bdc7d75-30"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:74:05:3d"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tap482ffd97-c5"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:9e:a8:b7"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tap3fa496b2-da"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:45:e9:15"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tapb70b5aab-5a"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:cb:18:9a"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tapea450dd9-f5"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:16:38 user nova-compute[74233]:       <mac address="fa:16:3e:5b:29:8d"/>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:16:38 user nova-compute[74233]:       <target dev="tap86d00573-f6"/>
Oct 20 18:16:38 user nova-compute[74233]:     </interface>
Oct 20 18:16:38 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:16:38 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c/console.log" append="off"/>
Oct 20 18:16:38 user nova-compute[74233]:     </serial>
Oct 20 18:16:38 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:16:38 user nova-compute[74233]:     <video>
Oct 20 18:16:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:16:38 user nova-compute[74233]:     </video>
Oct 20 18:16:38 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:16:38 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:16:38 user nova-compute[74233]:     </rng>
Oct 20 18:16:38 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:16:38 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:16:38 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:16:38 user nova-compute[74233]:     </memballoon>
Oct 20 18:16:38 user nova-compute[74233]:   </devices>
Oct 20 18:16:38 user nova-compute[74233]: </domain>
Oct 20 18:16:38 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b09e8f9f-a109-5e49-95e7-cb01ec501c7e', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0b50651-f8, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0b50651-f8, col_values=(('qos', UUID('92e1e2f7-42e7-414f-aa8c-fddbdf15979f')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0b50651-f8, col_values=(('external_ids', {'iface-id': 'e0b50651-f865-4c34-8080-f3eaaa4d35ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:9b:d6', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8')
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c8d5ffc-934c-58db-a564-aeb4d55314d7', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bdc7d75-30, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bdc7d75-30, col_values=(('qos', UUID('8d5cff54-d825-4961-b019-d466b0170759')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bdc7d75-30, col_values=(('external_ids', {'iface-id': '3bdc7d75-307c-4da7-bd53-1ea965385267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:35:8c', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30')
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eacd0e4-2c5c-5586-af8f-b3e9f1760160', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap482ffd97-c5, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap482ffd97-c5, col_values=(('qos', UUID('c07a2638-a039-4d10-a398-56e55af6a7c3')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap482ffd97-c5, col_values=(('external_ids', {'iface-id': '482ffd97-c560-48db-9a6d-e31105c795d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:05:3d', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5')
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da339a36-c8e7-5ef4-886b-73432992e4dd', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fa496b2-da, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fa496b2-da, col_values=(('qos', UUID('a4130a49-d155-4845-80ea-048fb86763db')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fa496b2-da, col_values=(('external_ids', {'iface-id': '3fa496b2-da99-4d66-aff9-7300f3e53104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a8:b7', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da')
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c78ac8-86d1-5054-8f6e-c14e1876ebf4', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb70b5aab-5a, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb70b5aab-5a, col_values=(('qos', UUID('958d65ff-a40c-489d-a218-44cbe02f4ee0')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb70b5aab-5a, col_values=(('external_ids', {'iface-id': 'b70b5aab-5ae7-4ab2-a185-33e1b70cc291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:e9:15', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a')
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9b43543-11e5-51a9-95e7-4d923d1aa881', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea450dd9-f5, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea450dd9-f5, col_values=(('qos', UUID('7293a2b1-eb30-4421-b992-4ec4ce70b90e')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea450dd9-f5, col_values=(('external_ids', {'iface-id': 'ea450dd9-f552-4ade-9342-7e288f6d4ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:18:9a', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5')
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4169748-bfe9-5390-8d62-fdfcfa3ad22a', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86d00573-f6, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86d00573-f6, col_values=(('qos', UUID('01519470-a40e-407a-990c-cf93d9069a8a')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86d00573-f6, col_values=(('external_ids', {'iface-id': '86d00573-f6f4-4818-af54-87e252612426', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:29:8d', 'vm-uuid': 'cbc2e0b7-b29a-400e-8a29-2d6bd88a511c'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:16:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:16:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:39 user nova-compute[74233]: INFO os_vif [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6')
Oct 20 18:16:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] No BDM found with device name hda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] No VIF found with MAC fa:16:3e:33:9b:d6, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:16:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] No VIF found with MAC fa:16:3e:45:e9:15, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:16:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Using config drive
Oct 20 18:16:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Creating config drive at /opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c/disk.config
Oct 20 18:16:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjhyq18i1 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjhyq18i1" returned: 0 in 0.062s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff7f9d5b-4899-43fe-adee-d3615b20c749 req-793f234a-87ac-491b-b277-cd104f4f5eb9 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff7f9d5b-4899-43fe-adee-d3615b20c749 req-793f234a-87ac-491b-b277-cd104f4f5eb9 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff7f9d5b-4899-43fe-adee-d3615b20c749 req-793f234a-87ac-491b-b277-cd104f4f5eb9 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff7f9d5b-4899-43fe-adee-d3615b20c749 req-793f234a-87ac-491b-b277-cd104f4f5eb9 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff7f9d5b-4899-43fe-adee-d3615b20c749 req-793f234a-87ac-491b-b277-cd104f4f5eb9 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:41 user nova-compute[74233]: WARNING nova.compute.manager [req-ff7f9d5b-4899-43fe-adee-d3615b20c749 req-793f234a-87ac-491b-b277-cd104f4f5eb9 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed for instance with vm_state building and task_state spawning.
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-19908b4a-084e-4e97-9f81-3a8b8bd37828 req-c412f533-c47a-4859-8af6-608e7dece50a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-19908b4a-084e-4e97-9f81-3a8b8bd37828 req-c412f533-c47a-4859-8af6-608e7dece50a service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-19908b4a-084e-4e97-9f81-3a8b8bd37828 req-c412f533-c47a-4859-8af6-608e7dece50a service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-19908b4a-084e-4e97-9f81-3a8b8bd37828 req-c412f533-c47a-4859-8af6-608e7dece50a service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-19908b4a-084e-4e97-9f81-3a8b8bd37828 req-c412f533-c47a-4859-8af6-608e7dece50a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:41 user nova-compute[74233]: WARNING nova.compute.manager [req-19908b4a-084e-4e97-9f81-3a8b8bd37828 req-c412f533-c47a-4859-8af6-608e7dece50a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 for instance with vm_state building and task_state spawning.
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff8689f7-6692-4e38-b40f-8983c1f05d3b req-1251b903-7bb3-444d-a0c3-e7820e73470f service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff8689f7-6692-4e38-b40f-8983c1f05d3b req-1251b903-7bb3-444d-a0c3-e7820e73470f service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff8689f7-6692-4e38-b40f-8983c1f05d3b req-1251b903-7bb3-444d-a0c3-e7820e73470f service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff8689f7-6692-4e38-b40f-8983c1f05d3b req-1251b903-7bb3-444d-a0c3-e7820e73470f service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff8689f7-6692-4e38-b40f-8983c1f05d3b req-1251b903-7bb3-444d-a0c3-e7820e73470f service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:42 user nova-compute[74233]: WARNING nova.compute.manager [req-ff8689f7-6692-4e38-b40f-8983c1f05d3b req-1251b903-7bb3-444d-a0c3-e7820e73470f service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 for instance with vm_state building and task_state spawning.
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-1d7303a9-00b6-49b9-b4df-8920c575b4e8 req-be87632a-9305-4e57-a31f-00a6cf438f88 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-85770f2d-d8c1-4214-b671-fa4a7a65e889 req-997934cc-25e9-4eb8-bc2a-d5146c21918b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-85770f2d-d8c1-4214-b671-fa4a7a65e889 req-997934cc-25e9-4eb8-bc2a-d5146c21918b service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-85770f2d-d8c1-4214-b671-fa4a7a65e889 req-997934cc-25e9-4eb8-bc2a-d5146c21918b service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-85770f2d-d8c1-4214-b671-fa4a7a65e889 req-997934cc-25e9-4eb8-bc2a-d5146c21918b service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-85770f2d-d8c1-4214-b671-fa4a7a65e889 req-997934cc-25e9-4eb8-bc2a-d5146c21918b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:43 user nova-compute[74233]: WARNING nova.compute.manager [req-85770f2d-d8c1-4214-b671-fa4a7a65e889 req-997934cc-25e9-4eb8-bc2a-d5146c21918b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 for instance with vm_state building and task_state spawning.
Oct 20 18:16:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:44 user nova-compute[74233]: WARNING nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 for instance with vm_state building and task_state spawning.
Oct 20 18:16:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:44 user nova-compute[74233]: WARNING nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 for instance with vm_state building and task_state spawning.
Oct 20 18:16:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:16:44 user nova-compute[74233]: WARNING nova.compute.manager [req-1d53dad7-cd3a-4264-9612-038fa0e1d697 req-2b8cbc6e-e08d-4103-a6a0-9948fc56fa73 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 for instance with vm_state building and task_state spawning.
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:16:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance spawned successfully.
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:16:45 user nova-compute[74233]: INFO nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Took 11.26 seconds to spawn the instance on the hypervisor.
Oct 20 18:16:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:16:45 user nova-compute[74233]: INFO nova.compute.manager [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Took 112.23 seconds to build instance.
Oct 20 18:16:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2a228f3d-c162-4d59-9e2d-5f8128f250ac tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 112.374s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:51 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:16:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:16:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:55 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:16:56 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:56 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:16:56 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd8a8ed-6454-42fd-a1dd-0b473afae699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:16:56 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[673d281d-a875-4842-b06a-5cd982afca03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0] added
Oct 20 18:16:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda207b-ef9c-48ac-b0e0-02af98186e7b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c6b84-b690-4402-8218-424880c7d9cc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGPkeMNs {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGPkeMNs" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9507a-a6b5-4408-b717-623111529725]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGPkeMNs'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[375db27c-376b-487b-97cd-85dae2e870c2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada76868-71f5-4a46-bf39-696597245245]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d717df7-27a9-446e-b935-a1122324d16d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]
Oct 20 18:16:56 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.
Oct 20 18:16:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[69156451-ce77-4721-80da-3207844aaea9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abe2460-2e8b-4952-a777-8a91d75b594f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:16:56 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] HCTL ('39', '-', '-', 0) found on session 25 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d28465-f719-4297-acb2-2948082024c8]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching for a device in session 25 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:56 user nova-compute[74233]: INFO nova.compute.manager [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] [instance: 947602c4-d7be-446e-87bc-b0137ac37f36] Took 19.21 seconds to detach 3 volumes for instance.
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23065616662383131', 'path': '/dev/sdh'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616662383131', 'path': '/dev/sdh'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'flavor' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:16:57 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:16:57 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:16:57 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:16:57 user nova-compute[74233]:   <serial>19627e31-7ae4-40ce-b918-f135c4fedae0</serial>
Oct 20 18:16:57 user nova-compute[74233]: </disk>
Oct 20 18:16:57 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.745s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:57 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Deleted allocations for instance 947602c4-d7be-446e-87bc-b0137ac37f36
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-eb961a8a-1c1d-4018-9631-69a438df26f1 tempest-TaggedBootDevicesTest-1557453215 tempest-TaggedBootDevicesTest-1557453215-project-member] Lock "947602c4-d7be-446e-87bc-b0137ac37f36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 27.530s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:16:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No VIF found with MAC fa:16:3e:d2:f5:f0, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ac9885d4-21b6-4f24-a6b1-4eacc5158340 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.070s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:16:59 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:59 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.119915008544922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dbb80f53-2ced-431d-9315-c911c6b72f4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e0124740-defc-4aff-9a68-9c3604f1d3c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 69779d06-b30a-4986-a7ee-b7d365236f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance e4677c3b-49b7-46f3-9539-7967340b93c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:16:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:00 user nova-compute[74233]: INFO nova.compute.manager [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Terminating instance
Oct 20 18:17:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-68b85a9c-7c41-4293-98c7-d8804ef67cca req-013c4b89-5eda-4dd9-b0ad-6bd0132854d2 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-unplugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-68b85a9c-7c41-4293-98c7-d8804ef67cca req-013c4b89-5eda-4dd9-b0ad-6bd0132854d2 service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-68b85a9c-7c41-4293-98c7-d8804ef67cca req-013c4b89-5eda-4dd9-b0ad-6bd0132854d2 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-68b85a9c-7c41-4293-98c7-d8804ef67cca req-013c4b89-5eda-4dd9-b0ad-6bd0132854d2 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-68b85a9c-7c41-4293-98c7-d8804ef67cca req-013c4b89-5eda-4dd9-b0ad-6bd0132854d2 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-unplugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-68b85a9c-7c41-4293-98c7-d8804ef67cca req-013c4b89-5eda-4dd9-b0ad-6bd0132854d2 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-unplugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Instance destroyed successfully.
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lazy-loading 'resources' on Instance uuid e0124740-defc-4aff-9a68-9c3604f1d3c9 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1201646160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1201646160',id=18,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo3juU9QtgRoMQR1EtjA6PLjYxT3Wlrm5RmihYFup2rQhBn57VooW8HQZLEv2/0X4bNpoI2V0oilwUdZ0xbLOKF/LwVH2xHv4zyb8OlH59+QuioT2WlTZXNo1uXWcnxpA==',key_name='tempest-keypair-1836308097',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='241507110dbc42719d74f9c1c8795d7f',ramdisk_id='',reservation_id='r-d6eop3hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1226898318',owner_user_name='tempest-TaggedAttachmentsTest-1226898318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bc0d56bcb4244c4a8f15522ca7fc78a',uuid=e0124740-defc-4aff-9a68-9c3604f1d3c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converting VIF {"id": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "address": "fa:16:3e:77:e9:45", "network": {"id": "69576ad2-fd0f-4a09-9106-ab705704d2c7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029693362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "241507110dbc42719d74f9c1c8795d7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d6651b-0f", "ovs_interfaceid": "e1d6651b-0fe2-47f6-ba08-7d8db7c28342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG os_vif [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d6651b-0f, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77e5fb44-ed52-46ce-9c32-4cbaf83fb29a) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:01 user nova-compute[74233]: INFO os_vif [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:e9:45,bridge_name='br-int',has_traffic_filtering=True,id=e1d6651b-0fe2-47f6-ba08-7d8db7c28342,network=Network(69576ad2-fd0f-4a09-9106-ab705704d2c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d6651b-0f')
Oct 20 18:17:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Deleting instance files /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9_del
Oct 20 18:17:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Deletion of /opt/stack/data/nova/instances/e0124740-defc-4aff-9a68-9c3604f1d3c9_del complete
Oct 20 18:17:01 user nova-compute[74233]: INFO nova.compute.manager [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 20 18:17:01 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:17:01 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:17:02 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:02 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Took 0.75 seconds to deallocate network for instance.
Oct 20 18:17:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-a6c43675-cec7-49d6-9351-7df31b74989c req-d8ac9e42-dd2b-47dc-9527-277b85d7aae1 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-deleted-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-6b9ff169-592a-48ae-b644-1d7dee0aad6e req-98ae7ef0-d430-4af4-b6fb-c0651b578437 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received event network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b9ff169-592a-48ae-b644-1d7dee0aad6e req-98ae7ef0-d430-4af4-b6fb-c0651b578437 service nova] Acquiring lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b9ff169-592a-48ae-b644-1d7dee0aad6e req-98ae7ef0-d430-4af4-b6fb-c0651b578437 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b9ff169-592a-48ae-b644-1d7dee0aad6e req-98ae7ef0-d430-4af4-b6fb-c0651b578437 service nova] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-6b9ff169-592a-48ae-b644-1d7dee0aad6e req-98ae7ef0-d430-4af4-b6fb-c0651b578437 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] No waiting events found dispatching network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:03 user nova-compute[74233]: WARNING nova.compute.manager [req-6b9ff169-592a-48ae-b644-1d7dee0aad6e req-98ae7ef0-d430-4af4-b6fb-c0651b578437 service nova] [instance: e0124740-defc-4aff-9a68-9c3604f1d3c9] Received unexpected event network-vif-plugged-e1d6651b-0fe2-47f6-ba08-7d8db7c28342 for instance with vm_state deleted and task_state None.
Oct 20 18:17:03 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:17:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:03 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Deleted allocations for instance e0124740-defc-4aff-9a68-9c3604f1d3c9
Oct 20 18:17:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4b144db7-5e6d-47ab-8763-aa5de23e2719 tempest-TaggedAttachmentsTest-1226898318 tempest-TaggedAttachmentsTest-1226898318-project-member] Lock "e0124740-defc-4aff-9a68-9c3604f1d3c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.571s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-changed-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing instance network info cache due to event network-changed-b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing network info cache for port b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updated VIF entry in instance network info cache for port b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-38e0b80b-1c4d-4639-bd4f-d24e1f2df4cb req-88fffad2-befb-4594-8b76-30e3b7551d95 service nova] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-changed-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing instance network info cache due to event network-changed-b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing network info cache for port b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updated VIF entry in instance network info cache for port b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2a61377a-a524-4a2c-af40-45c22f802972 req-7789e384-bf12-40f0-9049-fdccd1fa6fb2 service nova] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:30 user nova-compute[74233]: INFO nova.compute.manager [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Rebooting instance
Oct 20 18:17:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-751cafc8-863b-4643-a0ad-a7370fb1f746 req-bbc439cc-ccf6-4155-83ff-2e2da0ffa754 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-unplugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-751cafc8-863b-4643-a0ad-a7370fb1f746 req-bbc439cc-ccf6-4155-83ff-2e2da0ffa754 service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-751cafc8-863b-4643-a0ad-a7370fb1f746 req-bbc439cc-ccf6-4155-83ff-2e2da0ffa754 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-751cafc8-863b-4643-a0ad-a7370fb1f746 req-bbc439cc-ccf6-4155-83ff-2e2da0ffa754 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-751cafc8-863b-4643-a0ad-a7370fb1f746 req-bbc439cc-ccf6-4155-83ff-2e2da0ffa754 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-unplugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:31 user nova-compute[74233]: WARNING nova.compute.manager [req-751cafc8-863b-4643-a0ad-a7370fb1f746 req-bbc439cc-ccf6-4155-83ff-2e2da0ffa754 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-unplugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:17:31 user nova-compute[74233]: INFO nova.compute.claims [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Claim successful on node user
Oct 20 18:17:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance destroyed successfully.
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'resources' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1391362163',display_name='tempest-TestMinimumBasicScenario-server-1391362163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1391362163',id=19,image_ref='78a60768-e10c-41c2-a821-2dea067b1501',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTkMoRSQXY+jyqTWauF0wzef2Z+CWqAlh3BrEaFOkDDuAiMmOfOzBHfpez7VQwr7bsIxrYYA6Taq3GGVDAFJfy2aNRwzVvqB+piX+GPwaWljU80xinC68nnlHoyShT5uA==',key_name='tempest-TestMinimumBasicScenario-393850783',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-lqnau87h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='78a60768-e10c-41c2-a821-2dea067b1501',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:17:31Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=69779d06-b30a-4986-a7ee-b7d365236f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2da9146-db, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4df33b1-e93e-42f2-9d33-12fddb8ec800) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:31 user nova-compute[74233]: INFO os_vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db')
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:17:31 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[defb6356-c30d-43f4-870b-cef0c3fae1e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:17:31 user nova-compute[74233]: No targets found.
Oct 20 18:17:31 user nova-compute[74233]: iSNS:
Oct 20 18:17:31 user nova-compute[74233]: No targets found.
Oct 20 18:17:31 user nova-compute[74233]: STATIC:
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:17:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:31 user nova-compute[74233]: FIRMWARE:
Oct 20 18:17:31 user nova-compute[74233]: No targets found.
Oct 20 18:17:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:17:31 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:17:31 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf1eabd-9308-46b6-840a-1bb9aabe0572]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d60b7-400d-4226-9b69-174c67eba905]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9701745e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0'): ({'sdh'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Removing single pathed devices sdh {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f7b353-3810-4523-b251-75f273574dde]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b0b3f8-361a-4659-9ef0-d4bdd545428f]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flushing IO for device /dev/sdh {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8e46b5-b09d-4f0b-afed-b047c5aaee56]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccff9de-0ebe-4d1e-9f59-654bff269a16]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17299e7-f159-489e-adf8-b2b8c908182c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc89c8c-19eb-479b-acaf-52cf5f68cd37]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]
Oct 20 18:17:32 user nova-compute[74233]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.network.neutron [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da18f96-e380-42cf-9b50-9fffc0e550fa]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] <== disconnect_volume: return (356ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:17:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Start _get_guest_xml network_info=[{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=78a60768-e10c-41c2-a821-2dea067b1501,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '78a60768-e10c-41c2-a821-2dea067b1501'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '5044ac00-e3cd-470d-92cd-3dfa06f313c7', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '69779d06-b30a-4986-a7ee-b7d365236f77', 'attached_at': '', 'detached_at': '', 'volume_id': '19627e31-7ae4-40ce-b918-f135c4fedae0', 'serial': '19627e31-7ae4-40ce-b918-f135c4fedae0'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:17:32 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:17:32 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=78a60768-e10c-41c2-a821-2dea067b1501,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.objects.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Object Instance<69779d06-b30a-4986-a7ee-b7d365236f77> lazy-loaded attributes: resources,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:17:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:17:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:17:32 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.policy [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5149d5d6d1f486c87a0c808597a40f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c937ee3474848de8b761d88e32f6447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:17:32 user nova-compute[74233]: INFO nova.virt.block_device [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Booting with volume-backed-image eaa6d842-3abb-4a80-92cd-b9a50e121c9f at /dev/vda
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451c0d7-70e4-422d-8e8b-6ebfcb66b33c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:17:32 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b23e8b-4249-4f17-8f53-4c42155df91e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0] added
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc47aef-256f-48b2-8f23-a8d314458176]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[938bd3b2-91d0-4b9a-906b-7a226b78fb7f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGPkeMNs {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGPkeMNs" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0801d161-9238-4b02-8547-73606d723424]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGPkeMNs'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac091dfb-558e-4f64-a47d-0f36f48259b1]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0c12af-aff6-42d3-931a-4c75697b6acd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83a17da-dcc9-4cfb-886a-ee9b29edfb72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]
Oct 20 18:17:32 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d05369-a524-4840-99ff-5fa176017b5c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f322c86-7486-4e3a-9d3a-762070baab45]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3958ffb-1205-4c68-b15e-7c74524eec77]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:17:32 user nova-compute[74233]: DEBUG nova.network.neutron [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Successfully created port: 39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-b82e4c85-e0b0-4fff-8c55-29d8919ef27d req-c72f7211-aaef-488a-ad65-9f0f4741cbb1 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b82e4c85-e0b0-4fff-8c55-29d8919ef27d req-c72f7211-aaef-488a-ad65-9f0f4741cbb1 service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b82e4c85-e0b0-4fff-8c55-29d8919ef27d req-c72f7211-aaef-488a-ad65-9f0f4741cbb1 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b82e4c85-e0b0-4fff-8c55-29d8919ef27d req-c72f7211-aaef-488a-ad65-9f0f4741cbb1 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-b82e4c85-e0b0-4fff-8c55-29d8919ef27d req-c72f7211-aaef-488a-ad65-9f0f4741cbb1 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:33 user nova-compute[74233]: WARNING nova.compute.manager [req-b82e4c85-e0b0-4fff-8c55-29d8919ef27d req-c72f7211-aaef-488a-ad65-9f0f4741cbb1 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 18:17:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23065616662383131', 'path': '/dev/sdh'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616662383131', 'path': '/dev/sdh'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1391362163',display_name='tempest-TestMinimumBasicScenario-server-1391362163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1391362163',id=19,image_ref='78a60768-e10c-41c2-a821-2dea067b1501',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTkMoRSQXY+jyqTWauF0wzef2Z+CWqAlh3BrEaFOkDDuAiMmOfOzBHfpez7VQwr7bsIxrYYA6Taq3GGVDAFJfy2aNRwzVvqB+piX+GPwaWljU80xinC68nnlHoyShT5uA==',key_name='tempest-TestMinimumBasicScenario-393850783',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-lqnau87h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='78a60768-e10c-41c2-a821-2dea067b1501',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:17:31Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=69779d06-b30a-4986-a7ee-b7d365236f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'pci_devices' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.objects.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Object Instance<69779d06-b30a-4986-a7ee-b7d365236f77> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:17:33 user nova-compute[74233]:   <uuid>69779d06-b30a-4986-a7ee-b7d365236f77</uuid>
Oct 20 18:17:33 user nova-compute[74233]:   <name>instance-00000013</name>
Oct 20 18:17:33 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:17:33 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:17:33 user nova-compute[74233]:   <metadata>
Oct 20 18:17:33 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:17:33 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:17:33 user nova-compute[74233]:       <nova:name>tempest-TestMinimumBasicScenario-server-1391362163</nova:name>
Oct 20 18:17:33 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:17:32</nova:creationTime>
Oct 20 18:17:33 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:17:33 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:17:33 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:17:33 user nova-compute[74233]:       <nova:owner>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:user uuid="50fe59facf744cf5b860e3b60995c05a">tempest-TestMinimumBasicScenario-1650546036-project-member</nova:user>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:project uuid="48d191f70cfa47cfbf249e5a33695689">tempest-TestMinimumBasicScenario-1650546036</nova:project>
Oct 20 18:17:33 user nova-compute[74233]:       </nova:owner>
Oct 20 18:17:33 user nova-compute[74233]:       <nova:root type="image" uuid="78a60768-e10c-41c2-a821-2dea067b1501"/>
Oct 20 18:17:33 user nova-compute[74233]:       <nova:ports>
Oct 20 18:17:33 user nova-compute[74233]:         <nova:port uuid="b2da9146-db38-4031-b048-53c42d4fe002">
Oct 20 18:17:33 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 18:17:33 user nova-compute[74233]:         </nova:port>
Oct 20 18:17:33 user nova-compute[74233]:       </nova:ports>
Oct 20 18:17:33 user nova-compute[74233]:     </nova:instance>
Oct 20 18:17:33 user nova-compute[74233]:   </metadata>
Oct 20 18:17:33 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:17:33 user nova-compute[74233]:     <system>
Oct 20 18:17:33 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:17:33 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:17:33 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:17:33 user nova-compute[74233]:       <entry name="serial">69779d06-b30a-4986-a7ee-b7d365236f77</entry>
Oct 20 18:17:33 user nova-compute[74233]:       <entry name="uuid">69779d06-b30a-4986-a7ee-b7d365236f77</entry>
Oct 20 18:17:33 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:17:33 user nova-compute[74233]:     </system>
Oct 20 18:17:33 user nova-compute[74233]:   </sysinfo>
Oct 20 18:17:33 user nova-compute[74233]:   <os>
Oct 20 18:17:33 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:17:33 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:17:33 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:17:33 user nova-compute[74233]:   </os>
Oct 20 18:17:33 user nova-compute[74233]:   <features>
Oct 20 18:17:33 user nova-compute[74233]:     <acpi/>
Oct 20 18:17:33 user nova-compute[74233]:     <apic/>
Oct 20 18:17:33 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:17:33 user nova-compute[74233]:   </features>
Oct 20 18:17:33 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:17:33 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:17:33 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:17:33 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:17:33 user nova-compute[74233]:   </clock>
Oct 20 18:17:33 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:17:33 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:17:33 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:17:33 user nova-compute[74233]:   </cpu>
Oct 20 18:17:33 user nova-compute[74233]:   <devices>
Oct 20 18:17:33 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:17:33 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:17:33 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk"/>
Oct 20 18:17:33 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:17:33 user nova-compute[74233]:     </disk>
Oct 20 18:17:33 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:17:33 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:17:33 user nova-compute[74233]:       <source dev="/dev/sdh"/>
Oct 20 18:17:33 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:17:33 user nova-compute[74233]:       <serial>19627e31-7ae4-40ce-b918-f135c4fedae0</serial>
Oct 20 18:17:33 user nova-compute[74233]:     </disk>
Oct 20 18:17:33 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:17:33 user nova-compute[74233]:       <mac address="fa:16:3e:d2:f5:f0"/>
Oct 20 18:17:33 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:17:33 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:17:33 user nova-compute[74233]:       <target dev="tapb2da9146-db"/>
Oct 20 18:17:33 user nova-compute[74233]:     </interface>
Oct 20 18:17:33 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:17:33 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/console.log" append="off"/>
Oct 20 18:17:33 user nova-compute[74233]:     </serial>
Oct 20 18:17:33 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:17:33 user nova-compute[74233]:     <video>
Oct 20 18:17:33 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:17:33 user nova-compute[74233]:     </video>
Oct 20 18:17:33 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:17:33 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:17:33 user nova-compute[74233]:     </rng>
Oct 20 18:17:33 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:17:33 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:17:33 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:17:33 user nova-compute[74233]:     </memballoon>
Oct 20 18:17:33 user nova-compute[74233]:   </devices>
Oct 20 18:17:33 user nova-compute[74233]: </domain>
Oct 20 18:17:33 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.network.neutron [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Successfully updated port: 39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.network.neutron [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.network.neutron [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:17:33 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.objects.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Object Instance<69779d06-b30a-4986-a7ee-b7d365236f77> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.network.neutron [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updating instance_info_cache with network_info: [{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance network_info: |[{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2 --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Cannot resize image /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'migration_context' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.objects.base [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Object Instance<69779d06-b30a-4986-a7ee-b7d365236f77> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1391362163',display_name='tempest-TestMinimumBasicScenario-server-1391362163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1391362163',id=19,image_ref='78a60768-e10c-41c2-a821-2dea067b1501',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTkMoRSQXY+jyqTWauF0wzef2Z+CWqAlh3BrEaFOkDDuAiMmOfOzBHfpez7VQwr7bsIxrYYA6Taq3GGVDAFJfy2aNRwzVvqB+piX+GPwaWljU80xinC68nnlHoyShT5uA==',key_name='tempest-TestMinimumBasicScenario-393850783',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-lqnau87h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='78a60768-e10c-41c2-a821-2dea067b1501',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:17:31Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=69779d06-b30a-4986-a7ee-b7d365236f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG os_vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faae4cab-a756-5732-aea0-68f16ad77333', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2da9146-db, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2da9146-db, col_values=(('qos', UUID('ec5bde0b-5473-416c-93f3-1e09212f7737')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2da9146-db, col_values=(('external_ids', {'iface-id': 'b2da9146-db38-4031-b048-53c42d4fe002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:f5:f0', 'vm-uuid': '69779d06-b30a-4986-a7ee-b7d365236f77'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:34 user nova-compute[74233]: INFO os_vif [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db')
Oct 20 18:17:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-changed-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Refreshing instance network info cache due to event network-changed-39e7f593-9184-4b4d-9108-cc0f096e1a57. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] Acquiring lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] Acquired lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG nova.network.neutron [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Refreshing network info cache for port 39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:36 user nova-compute[74233]: DEBUG nova.network.neutron [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updated VIF entry in instance network info cache for port 39e7f593-9184-4b4d-9108-cc0f096e1a57. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:17:36 user nova-compute[74233]: DEBUG nova.network.neutron [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updating instance_info_cache with network_info: [{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-84823dbc-4077-468e-8803-559f2e8669c3 req-9b74d9aa-6d88-426b-9088-4d788b7cfd13 service nova] Releasing lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:37 user nova-compute[74233]: WARNING nova.compute.manager [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 18:17:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:37 user nova-compute[74233]: WARNING nova.compute.manager [req-f1e096c1-044a-4c34-8fee-c603fba10b61 req-3e43ad93-ce71-4ff9-b3e1-93a5fa9f4937 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 18:17:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:17:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance rebooted successfully.
Oct 20 18:17:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:17:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd4a0ca3-10f9-47b5-b50f-b1453bfc0a31 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.380s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-changed-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Refreshing instance network info cache due to event network-changed-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] Acquiring lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] Acquired lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Refreshing network info cache for port 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG os_brick.utils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9db932-f708-4976-a84f-4d5caa31926d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61792d22-0f3c-41b7-b6b6-e229d7cec0b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec823c8f-cb42-4251-9e6a-8b85325493a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a800d-f365-4578-9eec-4691d5306f86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:17:48 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5941ea3-46e5-441a-aa81-7b34f19f0d3a]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG os_brick.utils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updating existing volume attachment record: d78e5244-99f5-4ef6-89f2-db6de093c695 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updated VIF entry in instance network info cache for port 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updating instance_info_cache with network_info: [{"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:48 user nova-compute[74233]: INFO nova.compute.manager [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Terminating instance
Oct 20 18:17:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c03d570e-8d13-4e3b-a779-33668804461c req-2bb6de71-d9fb-46ee-860a-fd25bf7b0eb7 service nova] Releasing lock "refresh_cache-e4677c3b-49b7-46f3-9539-7967340b93c5" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-ec14e65c-efb6-4d9e-8840-1598d18312b4 req-62ef0a01-7cd5-46d7-950f-99338504b3b6 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-vif-unplugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ec14e65c-efb6-4d9e-8840-1598d18312b4 req-62ef0a01-7cd5-46d7-950f-99338504b3b6 service nova] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ec14e65c-efb6-4d9e-8840-1598d18312b4 req-62ef0a01-7cd5-46d7-950f-99338504b3b6 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ec14e65c-efb6-4d9e-8840-1598d18312b4 req-62ef0a01-7cd5-46d7-950f-99338504b3b6 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-ec14e65c-efb6-4d9e-8840-1598d18312b4 req-62ef0a01-7cd5-46d7-950f-99338504b3b6 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] No waiting events found dispatching network-vif-unplugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-ec14e65c-efb6-4d9e-8840-1598d18312b4 req-62ef0a01-7cd5-46d7-950f-99338504b3b6 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-vif-unplugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Instance destroyed successfully.
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'resources' on Instance uuid e4677c3b-49b7-46f3-9539-7967340b93c5 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1127723358',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1127723358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1127723358',id=24,image_ref='0e763535-47e8-4b88-8b30-fadca3a80106',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGFDpTRXv2Lylq94D4+q7Sw6EOyBXo4HfH+Yv7htQOiCj+wfsSVpzphtfUrodDxh5X+d7Jq8uIwL6it0mxXT6WikaC3aJR9+JYY3zK2dTzwjHomrj/losMduf02BcHv9A==',key_name='tempest-keypair-841064752',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-6ev6ir02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2006411708',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=e4677c3b-49b7-46f3-9539-7967340b93c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "address": "fa:16:3e:ea:d2:6e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a47ca8b-a7", "ovs_interfaceid": "5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_vif [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a47ca8b-a7, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60784441-df94-4b65-97c9-047e1ec9fc16) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:49 user nova-compute[74233]: INFO os_vif [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d2:6e,bridge_name='br-int',has_traffic_filtering=True,id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a47ca8b-a7')
Oct 20 18:17:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJpVbkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:17:49 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e59c03-d1ec-49c6-b1c2-d4ba54f4815e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:17:49 user nova-compute[74233]: No targets found.
Oct 20 18:17:49 user nova-compute[74233]: iSNS:
Oct 20 18:17:49 user nova-compute[74233]: No targets found.
Oct 20 18:17:49 user nova-compute[74233]: STATIC:
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:17:49 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:17:49 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:17:49 user nova-compute[74233]: FIRMWARE:
Oct 20 18:17:49 user nova-compute[74233]: No targets found.
Oct 20 18:17:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:17:49 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:17:49 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92d8ef8-89f9-4cd0-9971-95e4ee92cadf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5857e141-9928-4aed-a947-011ddb5ea313]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:17:49 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9506cbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f309d3-68bf-462f-8fda-5876203cbe9e]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.037s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8082ea-d635-447d-bbb2-47a8a4e6704a]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f5c5b-4d62-4df5-bf61-2ece4cb0ed57]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:17:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.166s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b21ae1-978d-4e09-8367-8054b7e61a50]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb3e16b-2d2b-41ed-ae27-a965e1390e75]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d5b91-e908-4037-8d38-e46e919968b7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260]
Oct 20 18:17:50 user nova-compute[74233]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1, portal: 172.16.0.220,3260] successful.
Oct 20 18:17:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b6f65-94a7-43eb-b986-db0f6d46d197]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== disconnect_volume: return (516ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:17:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Deleting instance files /opt/stack/data/nova/instances/e4677c3b-49b7-46f3-9539-7967340b93c5_del
Oct 20 18:17:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Deletion of /opt/stack/data/nova/instances/e4677c3b-49b7-46f3-9539-7967340b93c5_del complete
Oct 20 18:17:50 user nova-compute[74233]: INFO nova.compute.manager [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 20 18:17:50 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:17:50 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:17:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-a2d2540a-7c42-4fef-8913-7722f5309ebf req-e70afa07-36bd-4d07-b72c-ae3e993ebd02 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a2d2540a-7c42-4fef-8913-7722f5309ebf req-e70afa07-36bd-4d07-b72c-ae3e993ebd02 service nova] Acquiring lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a2d2540a-7c42-4fef-8913-7722f5309ebf req-e70afa07-36bd-4d07-b72c-ae3e993ebd02 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a2d2540a-7c42-4fef-8913-7722f5309ebf req-e70afa07-36bd-4d07-b72c-ae3e993ebd02 service nova] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-a2d2540a-7c42-4fef-8913-7722f5309ebf req-e70afa07-36bd-4d07-b72c-ae3e993ebd02 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] No waiting events found dispatching network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:17:51 user nova-compute[74233]: WARNING nova.compute.manager [req-a2d2540a-7c42-4fef-8913-7722f5309ebf req-e70afa07-36bd-4d07-b72c-ae3e993ebd02 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received unexpected event network-vif-plugged-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 for instance with vm_state active and task_state deleting.
Oct 20 18:17:51 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:51 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Took 1.14 seconds to deallocate network for instance.
Oct 20 18:17:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-fae99539-fb0d-447e-803a-0eb679bfb80e req-2d05c5f1-a00e-42f6-92ca-ce38b1256662 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Received event network-vif-deleted-5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:17:51 user nova-compute[74233]: INFO nova.compute.manager [req-fae99539-fb0d-447e-803a-0eb679bfb80e req-2d05c5f1-a00e-42f6-92ca-ce38b1256662 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Neutron deleted interface 5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03; detaching it from the instance and deleting it from the info cache
Oct 20 18:17:51 user nova-compute[74233]: DEBUG nova.network.neutron [req-fae99539-fb0d-447e-803a-0eb679bfb80e req-2d05c5f1-a00e-42f6-92ca-ce38b1256662 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-fae99539-fb0d-447e-803a-0eb679bfb80e req-2d05c5f1-a00e-42f6-92ca-ce38b1256662 service nova] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Detach interface failed, port_id=5a47ca8b-a76f-4b74-8c6a-35c1aaf71a03, reason: Instance e4677c3b-49b7-46f3-9539-7967340b93c5 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:17:52 user nova-compute[74233]: INFO nova.compute.manager [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 18:17:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: e4677c3b-49b7-46f3-9539-7967340b93c5] Deleting volume: a8c4c0ca-364a-40b6-a2f0-abee09e73cb1 {{(pid=74233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 18:17:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:17:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:17:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:53 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Deleted allocations for instance e4677c3b-49b7-46f3-9539-7967340b93c5
Oct 20 18:17:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bab58017-c737-410a-a374-c8f7013a9a23 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "e4677c3b-49b7-46f3-9539-7967340b93c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.243s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:17:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Skipping network cache update for instance because it is Building. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:17:57 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:17:58 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:17:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7854MB free_disk=25.14263916015625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dbb80f53-2ced-431d-9315-c911c6b72f4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 69779d06-b30a-4986-a7ee-b7d365236f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance bae683b9-94e9-4e4f-9621-93c2410d2351 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:18:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:18:02 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:18:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:18:02 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:18:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:04 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:04 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:18:07 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Creating image(s)
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Ensure instance console log exists: /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Start _get_guest_xml network_info=[{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'd78e5244-99f5-4ef6-89f2-db6de093c695', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bae683b9-94e9-4e4f-9621-93c2410d2351', 'attached_at': '', 'detached_at': '', 'volume_id': '2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'serial': '2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:18:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:18:07 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:18:07 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:18:07 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22797534-3bff-4520-bad9-ca24745c036d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:18:07 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c850b5a8-9c40-4de2-9a4c-89729d8d39b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3] added
Oct 20 18:18:07 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81db8584-8d6c-4584-8636-0e41dcae1372]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[01256fb1-570d-42bb-bb9f-96fe0f71a430]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPFEiXjl {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPFEiXjl" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e539b1b-d65f-4b96-92e7-972033cedf39]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPFEiXjl'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2fc61d-5408-4dc4-b3b5-834e98f98898]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e58391-e190-41ec-85be-db3f58557db0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f9cf6-0465-4246-b81b-70a6e4a310b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260]
Oct 20 18:18:08 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260] successful.
Oct 20 18:18:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce157d89-13e6-4645-bcfe-a71846386098]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f20850-259d-498b-9ee3-9e046ad51337]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:08 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e316156-52d7-450d-a5e2-6e00a3aa3461]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:08 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26366393065333433', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366393065333433', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839955891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839955891',id=25,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-n78n7z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:17:32Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=bae683b9-94e9-4e4f-9621-93c2410d2351,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.objects.instance [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'pci_devices' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:18:09 user nova-compute[74233]:   <uuid>bae683b9-94e9-4e4f-9621-93c2410d2351</uuid>
Oct 20 18:18:09 user nova-compute[74233]:   <name>instance-00000019</name>
Oct 20 18:18:09 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:18:09 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:18:09 user nova-compute[74233]:   <metadata>
Oct 20 18:18:09 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:18:09 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:18:09 user nova-compute[74233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1839955891</nova:name>
Oct 20 18:18:09 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:18:07</nova:creationTime>
Oct 20 18:18:09 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:18:09 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:18:09 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:18:09 user nova-compute[74233]:       <nova:owner>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:user uuid="a5149d5d6d1f486c87a0c808597a40f3">tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member</nova:user>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:project uuid="8c937ee3474848de8b761d88e32f6447">tempest-ServerBootFromVolumeStableRescueTest-481267461</nova:project>
Oct 20 18:18:09 user nova-compute[74233]:       </nova:owner>
Oct 20 18:18:09 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:18:09 user nova-compute[74233]:       <nova:ports>
Oct 20 18:18:09 user nova-compute[74233]:         <nova:port uuid="39e7f593-9184-4b4d-9108-cc0f096e1a57">
Oct 20 18:18:09 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 18:18:09 user nova-compute[74233]:         </nova:port>
Oct 20 18:18:09 user nova-compute[74233]:       </nova:ports>
Oct 20 18:18:09 user nova-compute[74233]:     </nova:instance>
Oct 20 18:18:09 user nova-compute[74233]:   </metadata>
Oct 20 18:18:09 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:18:09 user nova-compute[74233]:     <system>
Oct 20 18:18:09 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:18:09 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:18:09 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:18:09 user nova-compute[74233]:       <entry name="serial">bae683b9-94e9-4e4f-9621-93c2410d2351</entry>
Oct 20 18:18:09 user nova-compute[74233]:       <entry name="uuid">bae683b9-94e9-4e4f-9621-93c2410d2351</entry>
Oct 20 18:18:09 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:18:09 user nova-compute[74233]:     </system>
Oct 20 18:18:09 user nova-compute[74233]:   </sysinfo>
Oct 20 18:18:09 user nova-compute[74233]:   <os>
Oct 20 18:18:09 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:18:09 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:18:09 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:18:09 user nova-compute[74233]:   </os>
Oct 20 18:18:09 user nova-compute[74233]:   <features>
Oct 20 18:18:09 user nova-compute[74233]:     <acpi/>
Oct 20 18:18:09 user nova-compute[74233]:     <apic/>
Oct 20 18:18:09 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:18:09 user nova-compute[74233]:   </features>
Oct 20 18:18:09 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:18:09 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:18:09 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:18:09 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:18:09 user nova-compute[74233]:   </clock>
Oct 20 18:18:09 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:18:09 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:18:09 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:18:09 user nova-compute[74233]:   </cpu>
Oct 20 18:18:09 user nova-compute[74233]:   <devices>
Oct 20 18:18:09 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:18:09 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:18:09 user nova-compute[74233]:       <source dev="/dev/sdd"/>
Oct 20 18:18:09 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:18:09 user nova-compute[74233]:       <serial>2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3</serial>
Oct 20 18:18:09 user nova-compute[74233]:     </disk>
Oct 20 18:18:09 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:18:09 user nova-compute[74233]:       <mac address="fa:16:3e:50:9c:7a"/>
Oct 20 18:18:09 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:18:09 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:18:09 user nova-compute[74233]:       <target dev="tap39e7f593-91"/>
Oct 20 18:18:09 user nova-compute[74233]:     </interface>
Oct 20 18:18:09 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:18:09 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/console.log" append="off"/>
Oct 20 18:18:09 user nova-compute[74233]:     </serial>
Oct 20 18:18:09 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:18:09 user nova-compute[74233]:     <video>
Oct 20 18:18:09 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:18:09 user nova-compute[74233]:     </video>
Oct 20 18:18:09 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:18:09 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:18:09 user nova-compute[74233]:     </rng>
Oct 20 18:18:09 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:18:09 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:18:09 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:18:09 user nova-compute[74233]:     </memballoon>
Oct 20 18:18:09 user nova-compute[74233]:   </devices>
Oct 20 18:18:09 user nova-compute[74233]: </domain>
Oct 20 18:18:09 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839955891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839955891',id=25,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-n78n7z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:17:32Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=bae683b9-94e9-4e4f-9621-93c2410d2351,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG os_vif [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c9d702-28d0-5c1f-8145-413c84a2259a', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39e7f593-91, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39e7f593-91, col_values=(('qos', UUID('2e1219a0-2aa4-4beb-ad11-f3556f1a2aa2')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39e7f593-91, col_values=(('external_ids', {'iface-id': '39e7f593-9184-4b4d-9108-cc0f096e1a57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:9c:7a', 'vm-uuid': 'bae683b9-94e9-4e4f-9621-93c2410d2351'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:09 user nova-compute[74233]: INFO os_vif [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91')
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:18:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No VIF found with MAC fa:16:3e:50:9c:7a, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-42c3073a-2829-4e0b-97f1-b7d450aa2b68 req-1b55f914-a1be-44f7-b078-09b2e28d1f89 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-42c3073a-2829-4e0b-97f1-b7d450aa2b68 req-1b55f914-a1be-44f7-b078-09b2e28d1f89 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-42c3073a-2829-4e0b-97f1-b7d450aa2b68 req-1b55f914-a1be-44f7-b078-09b2e28d1f89 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-42c3073a-2829-4e0b-97f1-b7d450aa2b68 req-1b55f914-a1be-44f7-b078-09b2e28d1f89 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-42c3073a-2829-4e0b-97f1-b7d450aa2b68 req-1b55f914-a1be-44f7-b078-09b2e28d1f89 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:10 user nova-compute[74233]: WARNING nova.compute.manager [req-42c3073a-2829-4e0b-97f1-b7d450aa2b68 req-1b55f914-a1be-44f7-b078-09b2e28d1f89 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state building and task_state spawning.
Oct 20 18:18:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:18:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance spawned successfully.
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:12 user nova-compute[74233]: INFO nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Took 5.13 seconds to spawn the instance on the hypervisor.
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-9e2734a8-5c38-4592-8bdb-fb009a375a12 req-ab79a6ed-5dac-4dd2-a04b-314cc8152cd3 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9e2734a8-5c38-4592-8bdb-fb009a375a12 req-ab79a6ed-5dac-4dd2-a04b-314cc8152cd3 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9e2734a8-5c38-4592-8bdb-fb009a375a12 req-ab79a6ed-5dac-4dd2-a04b-314cc8152cd3 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9e2734a8-5c38-4592-8bdb-fb009a375a12 req-ab79a6ed-5dac-4dd2-a04b-314cc8152cd3 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-9e2734a8-5c38-4592-8bdb-fb009a375a12 req-ab79a6ed-5dac-4dd2-a04b-314cc8152cd3 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:12 user nova-compute[74233]: WARNING nova.compute.manager [req-9e2734a8-5c38-4592-8bdb-fb009a375a12 req-ab79a6ed-5dac-4dd2-a04b-314cc8152cd3 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state building and task_state spawning.
Oct 20 18:18:12 user nova-compute[74233]: INFO nova.compute.manager [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Took 41.55 seconds to build instance.
Oct 20 18:18:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-100f83f3-dfcd-4f03-8b69-92c2dbb94170 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.664s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-changed-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing instance network info cache due to event network-changed-e0b50651-f865-4c34-8080-f3eaaa4d35ed. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] Acquiring lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] Acquired lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG nova.network.neutron [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Refreshing network info cache for port e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG nova.network.neutron [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updated VIF entry in instance network info cache for port e0b50651-f865-4c34-8080-f3eaaa4d35ed. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG nova.network.neutron [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3810672b-8772-4a21-8303-97be88d58255 req-f5f42684-d43c-4648-8517-bfa96dd2ba6d service nova] Releasing lock "refresh_cache-cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:28 user nova-compute[74233]: INFO nova.compute.manager [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Terminating instance
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:18:28 user nova-compute[74233]: INFO nova.compute.claims [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Claim successful on node user
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-15b11f80-c0cf-4e92-a6f8-2b5450de8508 req-82560df4-a623-4fc8-8090-3d56d3300a81 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-15b11f80-c0cf-4e92-a6f8-2b5450de8508 req-82560df4-a623-4fc8-8090-3d56d3300a81 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-15b11f80-c0cf-4e92-a6f8-2b5450de8508 req-82560df4-a623-4fc8-8090-3d56d3300a81 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-15b11f80-c0cf-4e92-a6f8-2b5450de8508 req-82560df4-a623-4fc8-8090-3d56d3300a81 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-15b11f80-c0cf-4e92-a6f8-2b5450de8508 req-82560df4-a623-4fc8-8090-3d56d3300a81 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-15b11f80-c0cf-4e92-a6f8-2b5450de8508 req-82560df4-a623-4fc8-8090-3d56d3300a81 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:18:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-a66a8e57-3b27-4a9e-9f5a-f12ea7e72771 req-e8715497-5c54-4f4c-bc56-6b69a1ae141d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a66a8e57-3b27-4a9e-9f5a-f12ea7e72771 req-e8715497-5c54-4f4c-bc56-6b69a1ae141d service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a66a8e57-3b27-4a9e-9f5a-f12ea7e72771 req-e8715497-5c54-4f4c-bc56-6b69a1ae141d service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a66a8e57-3b27-4a9e-9f5a-f12ea7e72771 req-e8715497-5c54-4f4c-bc56-6b69a1ae141d service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-a66a8e57-3b27-4a9e-9f5a-f12ea7e72771 req-e8715497-5c54-4f4c-bc56-6b69a1ae141d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-a66a8e57-3b27-4a9e-9f5a-f12ea7e72771 req-e8715497-5c54-4f4c-bc56-6b69a1ae141d service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG nova.policy [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd132de50b442419e8f3a059e650902e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0083be86b8f04d16a891eadad4dccbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:18:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:18:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Creating image(s)
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "/opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "/opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk 1073741824" returned: 0 in 0.083s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-c7c068d0-632f-43e0-8b98-ecabe2db501d req-90617b62-bfe0-4f16-8490-0e630e47da20 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c7c068d0-632f-43e0-8b98-ecabe2db501d req-90617b62-bfe0-4f16-8490-0e630e47da20 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c7c068d0-632f-43e0-8b98-ecabe2db501d req-90617b62-bfe0-4f16-8490-0e630e47da20 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c7c068d0-632f-43e0-8b98-ecabe2db501d req-90617b62-bfe0-4f16-8490-0e630e47da20 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-c7c068d0-632f-43e0-8b98-ecabe2db501d req-90617b62-bfe0-4f16-8490-0e630e47da20 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-c7c068d0-632f-43e0-8b98-ecabe2db501d req-90617b62-bfe0-4f16-8490-0e630e47da20 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-3bdc7d75-307c-4da7-bd53-1ea965385267 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Instance destroyed successfully.
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.objects.instance [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lazy-loading 'resources' on Instance uuid cbc2e0b7-b29a-400e-8a29-2d6bd88a511c {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0b50651-f8, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92e1e2f7-42e7-414f-aa8c-fddbdf15979f) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Cannot resize image /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Ensure instance console log exists: /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:9b:d6,bridge_name='br-int',has_traffic_filtering=True,id=e0b50651-f865-4c34-8080-f3eaaa4d35ed,network=Network(abb77923-d5a6-4980-9104-6180f4729d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b50651-f8')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bdc7d75-30, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d5cff54-d825-4961-b019-d466b0170759) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Successfully created port: 6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:35:8c,bridge_name='br-int',has_traffic_filtering=True,id=3bdc7d75-307c-4da7-bd53-1ea965385267,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bdc7d75-30')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap482ffd97-c5, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c07a2638-a039-4d10-a398-56e55af6a7c3) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:3d,bridge_name='br-int',has_traffic_filtering=True,id=482ffd97-c560-48db-9a6d-e31105c795d8,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap482ffd97-c5')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fa496b2-da, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4130a49-d155-4845-80ea-048fb86763db) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:b7,bridge_name='br-int',has_traffic_filtering=True,id=3fa496b2-da99-4d66-aff9-7300f3e53104,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa496b2-da')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb70b5aab-5a, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=958d65ff-a40c-489d-a218-44cbe02f4ee0) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:e9:15,bridge_name='br-int',has_traffic_filtering=True,id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291,network=Network(980da460-c2fc-48ee-b7bd-3e16cd24d0e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70b5aab-5a')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea450dd9-f5, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7293a2b1-eb30-4421-b992-4ec4ce70b90e) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:18:9a,bridge_name='br-int',has_traffic_filtering=True,id=ea450dd9-f552-4ade-9342-7e288f6d4ad5,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea450dd9-f5')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T18:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-455981786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-455981786',id=23,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qUjr4d98duAsF5z2wtTUCHeveSfNZZ9GYtQM67UwtZRTiBk5jSt9qyt/yuhZdO8Hw/sYI3NyJ46WihNFQfAbKfa6HRbg8gojBI7UZzzwyPUfevz0sk/f+ZriIxSRd5g==',key_name='tempest-keypair-1726297437',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cfb373bc1442729225e42dd93218c1',ramdisk_id='',reservation_id='r-0g014p2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1388277468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1388277468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04da36886f4a414cb75546d7fb188795',uuid=cbc2e0b7-b29a-400e-8a29-2d6bd88a511c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converting VIF {"id": "86d00573-f6f4-4818-af54-87e252612426", "address": "fa:16:3e:5b:29:8d", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d00573-f6", "ovs_interfaceid": "86d00573-f6f4-4818-af54-87e252612426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86d00573-f6, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01519470-a40e-407a-990c-cf93d9069a8a) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:30 user nova-compute[74233]: INFO os_vif [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:8d,bridge_name='br-int',has_traffic_filtering=True,id=86d00573-f6f4-4818-af54-87e252612426,network=Network(7dbda25a-5c60-4e7e-80f0-4ca5409055e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d00573-f6')
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmMAneyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:18:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af13719-41f6-4c1e-8731-7d1af29103ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:18:30 user nova-compute[74233]: No targets found.
Oct 20 18:18:30 user nova-compute[74233]: iSNS:
Oct 20 18:18:30 user nova-compute[74233]: No targets found.
Oct 20 18:18:30 user nova-compute[74233]: STATIC:
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: FIRMWARE:
Oct 20 18:18:30 user nova-compute[74233]: No targets found.
Oct 20 18:18:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:18:30 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:18:30 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:30 user nova-compute[74233]: WARNING nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-e0b50651-f865-4c34-8080-f3eaaa4d35ed for instance with vm_state active and task_state deleting.
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-482ffd97-c560-48db-9a6d-e31105c795d8 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:30 user nova-compute[74233]: WARNING nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-482ffd97-c560-48db-9a6d-e31105c795d8 for instance with vm_state active and task_state deleting.
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-0ca2f0f8-c89b-445a-acbc-0bd2d2763552 req-6d827d69-fc22-4688-98c2-44ffe4fa7cad service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-3fa496b2-da99-4d66-aff9-7300f3e53104 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59813e-7340-4738-a427-dce629da00d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fe2c6c-9dc7-4e94-815d-f1116d1c4eaf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9706c4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743'): ({'sdg'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Removing single pathed devices sdg {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e80618-20ee-4c2c-bf34-f014ac582ebf]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9d424-f6b4-4c21-b4a3-345287dd56ef]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Flushing IO for device /dev/sdg {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ae5c2-8daf-4970-acce-47237a32749a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c84d5-e196-4100-8579-bc29eb8af474]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ff2aa-05f7-4c61-8fb9-2e3989fd99ac]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Successfully updated port: 6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[76742320-ad8d-43cd-aaa0-8e84af0ff520]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260]
Oct 20 18:18:30 user nova-compute[74233]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743, portal: 172.16.0.220,3260] successful.
Oct 20 18:18:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039588a1-7d9f-4513-80a3-ec1074afd743 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef852b-2a90-4b2a-b6f3-654ccf974509]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== disconnect_volume: return (397ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kToUDKwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:18:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19016185-e2c8-4702-b9f8-b0df37f2bc73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:18:30 user nova-compute[74233]: No targets found.
Oct 20 18:18:30 user nova-compute[74233]: iSNS:
Oct 20 18:18:30 user nova-compute[74233]: No targets found.
Oct 20 18:18:30 user nova-compute[74233]: STATIC:
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:18:30 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:30 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:30 user nova-compute[74233]: FIRMWARE:
Oct 20 18:18:30 user nova-compute[74233]: No targets found.
Oct 20 18:18:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:18:30 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:18:30 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ecdd60-4d94-4546-8ea7-29e40870bbaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe900db-ff31-4aca-8996-6bdffeebbf37]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb97044c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c4975e-8171-4326-a629-3abff267aebc]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ad62d-6167-48da-b4a2-5fc776fe6248]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60283405-7601-43a8-b7a7-8c2eae09c79a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c81ecd-2449-4c7b-9b7b-5d01e2d8ef02]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Instance network_info: |[{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Start _get_guest_xml network_info=[{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[204030e8-1e61-45d4-87d3-1e5201d3d147]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:31 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-304316832',display_name='tempest-ServerActionsTestOtherA-server-304316832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-304316832',id=26,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-2b1xpfku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=9d8f3218-2a57-452f-8251-2d5591c9f09a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d8f3218-2a57-452f-8251-2d5591c9f09a {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:18:31 user nova-compute[74233]:   <uuid>9d8f3218-2a57-452f-8251-2d5591c9f09a</uuid>
Oct 20 18:18:31 user nova-compute[74233]:   <name>instance-0000001a</name>
Oct 20 18:18:31 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:18:31 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:18:31 user nova-compute[74233]:   <metadata>
Oct 20 18:18:31 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:18:31 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:18:31 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherA-server-304316832</nova:name>
Oct 20 18:18:31 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:18:31</nova:creationTime>
Oct 20 18:18:31 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:18:31 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:18:31 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:18:31 user nova-compute[74233]:       <nova:owner>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:user uuid="d132de50b442419e8f3a059e650902e7">tempest-ServerActionsTestOtherA-835796467-project-member</nova:user>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:project uuid="0083be86b8f04d16a891eadad4dccbe6">tempest-ServerActionsTestOtherA-835796467</nova:project>
Oct 20 18:18:31 user nova-compute[74233]:       </nova:owner>
Oct 20 18:18:31 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:18:31 user nova-compute[74233]:       <nova:ports>
Oct 20 18:18:31 user nova-compute[74233]:         <nova:port uuid="6d5340b7-026b-4367-bf48-c710ffca8ace">
Oct 20 18:18:31 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 18:18:31 user nova-compute[74233]:         </nova:port>
Oct 20 18:18:31 user nova-compute[74233]:       </nova:ports>
Oct 20 18:18:31 user nova-compute[74233]:     </nova:instance>
Oct 20 18:18:31 user nova-compute[74233]:   </metadata>
Oct 20 18:18:31 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:18:31 user nova-compute[74233]:     <system>
Oct 20 18:18:31 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:18:31 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:18:31 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:18:31 user nova-compute[74233]:       <entry name="serial">9d8f3218-2a57-452f-8251-2d5591c9f09a</entry>
Oct 20 18:18:31 user nova-compute[74233]:       <entry name="uuid">9d8f3218-2a57-452f-8251-2d5591c9f09a</entry>
Oct 20 18:18:31 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:18:31 user nova-compute[74233]:     </system>
Oct 20 18:18:31 user nova-compute[74233]:   </sysinfo>
Oct 20 18:18:31 user nova-compute[74233]:   <os>
Oct 20 18:18:31 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:18:31 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:18:31 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:18:31 user nova-compute[74233]:   </os>
Oct 20 18:18:31 user nova-compute[74233]:   <features>
Oct 20 18:18:31 user nova-compute[74233]:     <acpi/>
Oct 20 18:18:31 user nova-compute[74233]:     <apic/>
Oct 20 18:18:31 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:18:31 user nova-compute[74233]:   </features>
Oct 20 18:18:31 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:18:31 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:18:31 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:18:31 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:18:31 user nova-compute[74233]:   </clock>
Oct 20 18:18:31 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:18:31 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:18:31 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:18:31 user nova-compute[74233]:   </cpu>
Oct 20 18:18:31 user nova-compute[74233]:   <devices>
Oct 20 18:18:31 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:18:31 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:18:31 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk"/>
Oct 20 18:18:31 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:18:31 user nova-compute[74233]:     </disk>
Oct 20 18:18:31 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:18:31 user nova-compute[74233]:       <mac address="fa:16:3e:5d:de:fc"/>
Oct 20 18:18:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:18:31 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:18:31 user nova-compute[74233]:       <target dev="tap6d5340b7-02"/>
Oct 20 18:18:31 user nova-compute[74233]:     </interface>
Oct 20 18:18:31 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:18:31 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/console.log" append="off"/>
Oct 20 18:18:31 user nova-compute[74233]:     </serial>
Oct 20 18:18:31 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:18:31 user nova-compute[74233]:     <video>
Oct 20 18:18:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:18:31 user nova-compute[74233]:     </video>
Oct 20 18:18:31 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:18:31 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:18:31 user nova-compute[74233]:     </rng>
Oct 20 18:18:31 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:18:31 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:18:31 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:18:31 user nova-compute[74233]:     </memballoon>
Oct 20 18:18:31 user nova-compute[74233]:   </devices>
Oct 20 18:18:31 user nova-compute[74233]: </domain>
Oct 20 18:18:31 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-304316832',display_name='tempest-ServerActionsTestOtherA-server-304316832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-304316832',id=26,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-2b1xpfku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=9d8f3218-2a57-452f-8251-2d5591c9f09a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_vif [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4921c41e-5827-5c8d-a59f-2cc1ce986925', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5323137-1703-4207-a08d-9cf0543859de]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260]
Oct 20 18:18:31 user nova-compute[74233]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984, portal: 172.16.0.220,3260] successful.
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:31 user nova-compute[74233]: WARNING nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 for instance with vm_state active and task_state deleting.
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-86d00573-f6f4-4818-af54-87e252612426 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:31 user nova-compute[74233]: WARNING nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-86d00573-f6f4-4818-af54-87e252612426 for instance with vm_state active and task_state deleting.
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-changed-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Refreshing instance network info cache due to event network-changed-6d5340b7-026b-4367-bf48-c710ffca8ace. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.neutron [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Refreshing network info cache for port 6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d5340b7-02, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d5340b7-02, col_values=(('qos', UUID('d901d177-13f7-4ed8-bc0b-c6a4c817a914')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d5340b7-02, col_values=(('external_ids', {'iface-id': '6d5340b7-026b-4367-bf48-c710ffca8ace', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:de:fc', 'vm-uuid': '9d8f3218-2a57-452f-8251-2d5591c9f09a'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bab5f0b-1130-4a2f-b0f6-f32751698984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6696a8bb-5287-40ed-bb44-69a185ffa80e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: INFO os_vif [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02')
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== disconnect_volume: return (418ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXNTeZfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:18:31 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bb6ab4-fbed-4e65-b265-db39f406a90a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:18:31 user nova-compute[74233]: No targets found.
Oct 20 18:18:31 user nova-compute[74233]: iSNS:
Oct 20 18:18:31 user nova-compute[74233]: No targets found.
Oct 20 18:18:31 user nova-compute[74233]: STATIC:
Oct 20 18:18:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:18:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2
Oct 20 18:18:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:18:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:18:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:18:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:31 user nova-compute[74233]: FIRMWARE:
Oct 20 18:18:31 user nova-compute[74233]: No targets found.
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:18:31 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:18:31 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e132b-a1d9-47a7-823c-c2194b2378c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No VIF found with MAC fa:16:3e:5d:de:fc, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcd98ca-c253-4ad8-b9ee-a866ea6ece1b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970484e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2'): ({'sdf'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Removing single pathed devices sdf {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af3a70-8f9c-4bd5-a6e3-74f47f016011]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf1183-bd3b-4bce-994e-ecd905b818d0]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Flushing IO for device /dev/sdf {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4d1981-3ae9-4a90-9efa-b4f074a79add]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94886643-d51f-4b17-8e31-ec83d3417fdd]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e4a698-78ba-4e75-aefe-1cc9ef307105]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e374759-90fc-4c27-bda5-c6cac7726960]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260]
Oct 20 18:18:31 user nova-compute[74233]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2, portal: 172.16.0.220,3260] successful.
Oct 20 18:18:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b921a80-683b-49f8-8832-43dc5ab778c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe83aca4-18f2-4c21-8ad0-203d0237f290]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] <== disconnect_volume: return (358ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:18:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Deleting instance files /opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c_del
Oct 20 18:18:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Deletion of /opt/stack/data/nova/instances/cbc2e0b7-b29a-400e-8a29-2d6bd88a511c_del complete
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.neutron [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated VIF entry in instance network info cache for port 6d5340b7-026b-4367-bf48-c710ffca8ace. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.neutron [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-626503ff-90d9-4006-9aae-5286b1f2d7e8 req-576f5d9a-cf47-4a63-a397-0390a5b3cb78 service nova] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:18:31 user nova-compute[74233]: INFO nova.compute.manager [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Took 3.71 seconds to destroy the instance on the hypervisor.
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-d9f74398-ef97-4e33-90dd-84387d303ed6 req-af5d29c4-4292-46f3-afbc-6b7364e7a036 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d9f74398-ef97-4e33-90dd-84387d303ed6 req-af5d29c4-4292-46f3-afbc-6b7364e7a036 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d9f74398-ef97-4e33-90dd-84387d303ed6 req-af5d29c4-4292-46f3-afbc-6b7364e7a036 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d9f74398-ef97-4e33-90dd-84387d303ed6 req-af5d29c4-4292-46f3-afbc-6b7364e7a036 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-d9f74398-ef97-4e33-90dd-84387d303ed6 req-af5d29c4-4292-46f3-afbc-6b7364e7a036 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:31 user nova-compute[74233]: WARNING nova.compute.manager [req-d9f74398-ef97-4e33-90dd-84387d303ed6 req-af5d29c4-4292-46f3-afbc-6b7364e7a036 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-3bdc7d75-307c-4da7-bd53-1ea965385267 for instance with vm_state active and task_state deleting.
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:32 user nova-compute[74233]: WARNING nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-3fa496b2-da99-4d66-aff9-7300f3e53104 for instance with vm_state active and task_state deleting.
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-unplugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-unplugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Acquiring lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] No waiting events found dispatching network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:32 user nova-compute[74233]: WARNING nova.compute.manager [req-db5e99aa-ba50-430a-af24-7aa054a3732d req-52b2d6be-a317-41b0-aec2-1b134a853b31 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received unexpected event network-vif-plugged-ea450dd9-f552-4ade-9342-7e288f6d4ad5 for instance with vm_state active and task_state deleting.
Oct 20 18:18:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-da36246a-cf20-4b52-a354-33e274b90668 req-32ad4903-8213-41d0-b939-9ddcb47a764a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-deleted-86d00573-f6f4-4818-af54-87e252612426 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:33 user nova-compute[74233]: INFO nova.compute.manager [req-da36246a-cf20-4b52-a354-33e274b90668 req-32ad4903-8213-41d0-b939-9ddcb47a764a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Neutron deleted interface 86d00573-f6f4-4818-af54-87e252612426; detaching it from the instance and deleting it from the info cache
Oct 20 18:18:33 user nova-compute[74233]: DEBUG nova.network.neutron [req-da36246a-cf20-4b52-a354-33e274b90668 req-32ad4903-8213-41d0-b939-9ddcb47a764a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "address": "fa:16:3e:45:e9:15", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70b5aab-5a", "ovs_interfaceid": "b70b5aab-5ae7-4ab2-a185-33e1b70cc291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-da36246a-cf20-4b52-a354-33e274b90668 req-32ad4903-8213-41d0-b939-9ddcb47a764a service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Detach interface failed, port_id=86d00573-f6f4-4818-af54-87e252612426, reason: Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:18:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Instance spawned successfully.
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.compute.manager [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Took 7.25 seconds to build instance.
Oct 20 18:18:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6293df47-66c5-4661-b290-69f700d1a208 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.342s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-deleted-b70b5aab-5ae7-4ab2-a185-33e1b70cc291 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Neutron deleted interface b70b5aab-5ae7-4ab2-a185-33e1b70cc291; detaching it from the instance and deleting it from the info cache
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.network.neutron [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fa496b2-da99-4d66-aff9-7300f3e53104", "address": "fa:16:3e:9e:a8:b7", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa496b2-da", "ovs_interfaceid": "3fa496b2-da99-4d66-aff9-7300f3e53104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Detach interface failed, port_id=b70b5aab-5ae7-4ab2-a185-33e1b70cc291, reason: Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-deleted-3fa496b2-da99-4d66-aff9-7300f3e53104 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Neutron deleted interface 3fa496b2-da99-4d66-aff9-7300f3e53104; detaching it from the instance and deleting it from the info cache
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.network.neutron [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "address": "fa:16:3e:33:9b:d6", "network": {"id": "abb77923-d5a6-4980-9104-6180f4729d7e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-678048761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b50651-f8", "ovs_interfaceid": "e0b50651-f865-4c34-8080-f3eaaa4d35ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Detach interface failed, port_id=3fa496b2-da99-4d66-aff9-7300f3e53104, reason: Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-deleted-e0b50651-f865-4c34-8080-f3eaaa4d35ed {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Neutron deleted interface e0b50651-f865-4c34-8080-f3eaaa4d35ed; detaching it from the instance and deleting it from the info cache
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.network.neutron [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [{"id": "3bdc7d75-307c-4da7-bd53-1ea965385267", "address": "fa:16:3e:42:35:8c", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdc7d75-30", "ovs_interfaceid": "3bdc7d75-307c-4da7-bd53-1ea965385267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "482ffd97-c560-48db-9a6d-e31105c795d8", "address": "fa:16:3e:74:05:3d", "network": {"id": "980da460-c2fc-48ee-b7bd-3e16cd24d0e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2062714396", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482ffd97-c5", "ovs_interfaceid": "482ffd97-c560-48db-9a6d-e31105c795d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "address": "fa:16:3e:cb:18:9a", "network": {"id": "7dbda25a-5c60-4e7e-80f0-4ca5409055e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552904569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "79cfb373bc1442729225e42dd93218c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea450dd9-f5", "ovs_interfaceid": "ea450dd9-f552-4ade-9342-7e288f6d4ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-6299b82e-90b6-4711-8adc-dd1e7d21a075 req-cd341a5f-d9a3-4c70-b73d-22703dbb201b service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Detach interface failed, port_id=e0b50651-f865-4c34-8080-f3eaaa4d35ed, reason: Instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:18:35 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:35 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Took 3.93 seconds to deallocate network for instance.
Oct 20 18:18:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] No waiting events found dispatching network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:37 user nova-compute[74233]: WARNING nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received unexpected event network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace for instance with vm_state active and task_state None.
Oct 20 18:18:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Received event network-vif-deleted-ea450dd9-f552-4ade-9342-7e288f6d4ad5 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] No waiting events found dispatching network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:37 user nova-compute[74233]: WARNING nova.compute.manager [req-f2a3ad90-53b0-4f2e-ab4c-da39ffa7122e req-50ac78c4-5043-40a8-bef8-a54e758dbb07 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received unexpected event network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace for instance with vm_state active and task_state None.
Oct 20 18:18:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:18:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:18:38 user nova-compute[74233]: INFO nova.compute.claims [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Claim successful on node user
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:18:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.policy [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5560a7c568e54a76b94eb889229c78a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98418bca8ed4de094d230072e355984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:18:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Creating image(s)
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk 1073741824" returned: 0 in 0.059s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Successfully created port: 6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Cannot resize image /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Ensure instance console log exists: /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Successfully updated port: 6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-changed-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Refreshing instance network info cache due to event network-changed-6b4ef092-a79c-40e6-98a2-e6a45f6044c3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance network_info: |[{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Refreshing network info cache for port 6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start _get_guest_xml network_info=[{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:18:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:18:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.objects.instance [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:18:41 user nova-compute[74233]:   <uuid>6d03ff84-b768-404f-a319-dde83c0d334f</uuid>
Oct 20 18:18:41 user nova-compute[74233]:   <name>instance-0000001b</name>
Oct 20 18:18:41 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:18:41 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:18:41 user nova-compute[74233]:   <metadata>
Oct 20 18:18:41 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:18:41 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:18:41 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherB-server-906554630</nova:name>
Oct 20 18:18:41 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:18:40</nova:creationTime>
Oct 20 18:18:41 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:18:41 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:18:41 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:18:41 user nova-compute[74233]:       <nova:owner>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:user uuid="5560a7c568e54a76b94eb889229c78a5">tempest-ServerActionsTestOtherB-2120896258-project-member</nova:user>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:project uuid="c98418bca8ed4de094d230072e355984">tempest-ServerActionsTestOtherB-2120896258</nova:project>
Oct 20 18:18:41 user nova-compute[74233]:       </nova:owner>
Oct 20 18:18:41 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:18:41 user nova-compute[74233]:       <nova:ports>
Oct 20 18:18:41 user nova-compute[74233]:         <nova:port uuid="6b4ef092-a79c-40e6-98a2-e6a45f6044c3">
Oct 20 18:18:41 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 18:18:41 user nova-compute[74233]:         </nova:port>
Oct 20 18:18:41 user nova-compute[74233]:       </nova:ports>
Oct 20 18:18:41 user nova-compute[74233]:     </nova:instance>
Oct 20 18:18:41 user nova-compute[74233]:   </metadata>
Oct 20 18:18:41 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:18:41 user nova-compute[74233]:     <system>
Oct 20 18:18:41 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:18:41 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:18:41 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:18:41 user nova-compute[74233]:       <entry name="serial">6d03ff84-b768-404f-a319-dde83c0d334f</entry>
Oct 20 18:18:41 user nova-compute[74233]:       <entry name="uuid">6d03ff84-b768-404f-a319-dde83c0d334f</entry>
Oct 20 18:18:41 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:18:41 user nova-compute[74233]:     </system>
Oct 20 18:18:41 user nova-compute[74233]:   </sysinfo>
Oct 20 18:18:41 user nova-compute[74233]:   <os>
Oct 20 18:18:41 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:18:41 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:18:41 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:18:41 user nova-compute[74233]:   </os>
Oct 20 18:18:41 user nova-compute[74233]:   <features>
Oct 20 18:18:41 user nova-compute[74233]:     <acpi/>
Oct 20 18:18:41 user nova-compute[74233]:     <apic/>
Oct 20 18:18:41 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:18:41 user nova-compute[74233]:   </features>
Oct 20 18:18:41 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:18:41 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:18:41 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:18:41 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:18:41 user nova-compute[74233]:   </clock>
Oct 20 18:18:41 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:18:41 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:18:41 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:18:41 user nova-compute[74233]:   </cpu>
Oct 20 18:18:41 user nova-compute[74233]:   <devices>
Oct 20 18:18:41 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:18:41 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:18:41 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk"/>
Oct 20 18:18:41 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:18:41 user nova-compute[74233]:     </disk>
Oct 20 18:18:41 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:18:41 user nova-compute[74233]:       <mac address="fa:16:3e:8f:cb:6c"/>
Oct 20 18:18:41 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:18:41 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:18:41 user nova-compute[74233]:       <target dev="tap6b4ef092-a7"/>
Oct 20 18:18:41 user nova-compute[74233]:     </interface>
Oct 20 18:18:41 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:18:41 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/console.log" append="off"/>
Oct 20 18:18:41 user nova-compute[74233]:     </serial>
Oct 20 18:18:41 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:18:41 user nova-compute[74233]:     <video>
Oct 20 18:18:41 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:18:41 user nova-compute[74233]:     </video>
Oct 20 18:18:41 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:18:41 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:18:41 user nova-compute[74233]:     </rng>
Oct 20 18:18:41 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:18:41 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:18:41 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:18:41 user nova-compute[74233]:     </memballoon>
Oct 20 18:18:41 user nova-compute[74233]:   </devices>
Oct 20 18:18:41 user nova-compute[74233]: </domain>
Oct 20 18:18:41 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG os_vif [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a36e68a7-177f-5434-ae2c-b1f7390ca3f0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b4ef092-a7, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b4ef092-a7, col_values=(('qos', UUID('fcff4801-7838-4bb1-9de4-fc8fb9f691af')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b4ef092-a7, col_values=(('external_ids', {'iface-id': '6b4ef092-a79c-40e6-98a2-e6a45f6044c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:cb:6c', 'vm-uuid': '6d03ff84-b768-404f-a319-dde83c0d334f'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:41 user nova-compute[74233]: INFO os_vif [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7')
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No VIF found with MAC fa:16:3e:8f:cb:6c, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updated VIF entry in instance network info cache for port 6b4ef092-a79c-40e6-98a2-e6a45f6044c3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0924b19-d400-4cc0-95fb-b75460979efc req-74ca425f-1134-4df8-b4d7-613194221313 service nova] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-2f9958d1-d811-47ef-a7a5-a63edbe9cde0 req-57d281f6-7d03-4de5-bba8-5dd57f599248 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2f9958d1-d811-47ef-a7a5-a63edbe9cde0 req-57d281f6-7d03-4de5-bba8-5dd57f599248 service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2f9958d1-d811-47ef-a7a5-a63edbe9cde0 req-57d281f6-7d03-4de5-bba8-5dd57f599248 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2f9958d1-d811-47ef-a7a5-a63edbe9cde0 req-57d281f6-7d03-4de5-bba8-5dd57f599248 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-2f9958d1-d811-47ef-a7a5-a63edbe9cde0 req-57d281f6-7d03-4de5-bba8-5dd57f599248 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:42 user nova-compute[74233]: WARNING nova.compute.manager [req-2f9958d1-d811-47ef-a7a5-a63edbe9cde0 req-57d281f6-7d03-4de5-bba8-5dd57f599248 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state building and task_state spawning.
Oct 20 18:18:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:18:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance spawned successfully.
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-20a75ea6-b544-4fe3-adb9-822668cd3d3a req-f7b9df30-143e-4326-98e6-7ef75a66a242 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-20a75ea6-b544-4fe3-adb9-822668cd3d3a req-f7b9df30-143e-4326-98e6-7ef75a66a242 service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-20a75ea6-b544-4fe3-adb9-822668cd3d3a req-f7b9df30-143e-4326-98e6-7ef75a66a242 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-20a75ea6-b544-4fe3-adb9-822668cd3d3a req-f7b9df30-143e-4326-98e6-7ef75a66a242 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-20a75ea6-b544-4fe3-adb9-822668cd3d3a req-f7b9df30-143e-4326-98e6-7ef75a66a242 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:45 user nova-compute[74233]: WARNING nova.compute.manager [req-20a75ea6-b544-4fe3-adb9-822668cd3d3a req-f7b9df30-143e-4326-98e6-7ef75a66a242 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state building and task_state spawning.
Oct 20 18:18:45 user nova-compute[74233]: INFO nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 20 18:18:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:18:45 user nova-compute[74233]: INFO nova.compute.manager [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Took 6.53 seconds to build instance.
Oct 20 18:18:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-490e6504-3281-48ce-bd82-37d43e429236 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.639s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:49 user nova-compute[74233]: INFO nova.compute.manager [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] [instance: cbc2e0b7-b29a-400e-8a29-2d6bd88a511c] Took 13.96 seconds to detach 3 volumes for instance.
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:49 user nova-compute[74233]: INFO nova.compute.manager [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Terminating instance
Oct 20 18:18:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-bedd0248-5f7f-4883-af75-927e96b7efab req-2a4f1064-c2c5-442a-a43c-de3eff1d802f service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-unplugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bedd0248-5f7f-4883-af75-927e96b7efab req-2a4f1064-c2c5-442a-a43c-de3eff1d802f service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bedd0248-5f7f-4883-af75-927e96b7efab req-2a4f1064-c2c5-442a-a43c-de3eff1d802f service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bedd0248-5f7f-4883-af75-927e96b7efab req-2a4f1064-c2c5-442a-a43c-de3eff1d802f service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-bedd0248-5f7f-4883-af75-927e96b7efab req-2a4f1064-c2c5-442a-a43c-de3eff1d802f service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-unplugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-bedd0248-5f7f-4883-af75-927e96b7efab req-2a4f1064-c2c5-442a-a43c-de3eff1d802f service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-unplugged-d361737e-8157-4051-9970-4ac903ac279b for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:50 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Deleted allocations for instance cbc2e0b7-b29a-400e-8a29-2d6bd88a511c
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-30a9028d-8dad-4476-b942-c69c6a5322b2 tempest-TaggedBootDevicesTest_v242-1388277468 tempest-TaggedBootDevicesTest_v242-1388277468-project-member] Lock "cbc2e0b7-b29a-400e-8a29-2d6bd88a511c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.444s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Instance destroyed successfully.
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.objects.instance [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'resources' on Instance uuid dbb80f53-2ced-431d-9315-c911c6b72f4c {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-155631481',display_name='tempest-TestVolumeBootPattern-volume-backed-server-155631481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-155631481',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVmr2OcM4FDbAFDFJteCMtYaJoRuZTDzcZOs4FASKSmDJCL6u/lq356Vec0P0GBcmqFYdwvLosHY5HyeBOamEKUfvc8TuRduqZa6Y9XOUBLD8WoGfghrMn4w1FmwdEC6Q==',key_name='tempest-keypair-635002540',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:13:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-l4tg6399',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=dbb80f53-2ced-431d-9315-c911c6b72f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "d361737e-8157-4051-9970-4ac903ac279b", "address": "fa:16:3e:88:32:5a", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd361737e-81", "ovs_interfaceid": "d361737e-8157-4051-9970-4ac903ac279b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_vif [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd361737e-81, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca0b53e1-4643-402c-b16a-41bbf649013a) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:18:50 user nova-compute[74233]: INFO os_vif [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=d361737e-8157-4051-9970-4ac903ac279b,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd361737e-81')
Oct 20 18:18:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twpzxyeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:18:50 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.047s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1cc39-2581-4e4d-a35b-7330db4f7d4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:18:50 user nova-compute[74233]: No targets found.
Oct 20 18:18:50 user nova-compute[74233]: iSNS:
Oct 20 18:18:50 user nova-compute[74233]: No targets found.
Oct 20 18:18:50 user nova-compute[74233]: STATIC:
Oct 20 18:18:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d
Oct 20 18:18:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:18:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:18:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:18:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:18:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:18:50 user nova-compute[74233]: FIRMWARE:
Oct 20 18:18:50 user nova-compute[74233]: No targets found.
Oct 20 18:18:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:18:50 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:18:50 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa4a549-3473-43eb-a701-a8b6c22c592b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78376a41-5639-4f22-a593-f102e7aa69e5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:50 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:50 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:50 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d (non-flash)
Oct 20 18:18:50 user nova-compute[74233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:18:50 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:18:50 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:18:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950673400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0558e5e-609f-46c0-9506-b8d3844e9183]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e92ad9-f169-4c96-823f-07293c77d62a]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af84dbd-0482-48eb-85bb-ec97d2f2e70f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c82dc3-6a16-4c49-bba2-c86d1c8a78f8]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26637333761663465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8990f003', '/dev/disk/by-id/scsi-1SCST_BIO8990f003-f737af4e9d71a20e') {{(pid=85316) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20146570-b59d-4d30-8d4e-fa75258ec9f0]: (4, None) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa1156-68c7-489c-b1a7-5c48aad12d9f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e57e009-1bc5-4441-b590-d6a36c55994c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260]
Oct 20 18:18:51 user nova-compute[74233]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d, portal: 172.16.0.220,3260] successful.
Oct 20 18:18:51 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03601032-c5fc-4181-95bb-e1e278d2839d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b08a7-7864-4f81-be3e-5c6b40385072]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== disconnect_volume: return (470ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:18:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Deleting instance files /opt/stack/data/nova/instances/dbb80f53-2ced-431d-9315-c911c6b72f4c_del
Oct 20 18:18:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Deletion of /opt/stack/data/nova/instances/dbb80f53-2ced-431d-9315-c911c6b72f4c_del complete
Oct 20 18:18:51 user nova-compute[74233]: INFO nova.compute.manager [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 20 18:18:51 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:52 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Took 0.91 seconds to deallocate network for instance.
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:52 user nova-compute[74233]: WARNING nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received unexpected event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b for instance with vm_state active and task_state deleting.
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:52 user nova-compute[74233]: WARNING nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received unexpected event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b for instance with vm_state active and task_state deleting.
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:52 user nova-compute[74233]: WARNING nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received unexpected event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b for instance with vm_state active and task_state deleting.
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-unplugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-unplugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-unplugged-d361737e-8157-4051-9970-4ac903ac279b for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Acquiring lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] No waiting events found dispatching network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:18:52 user nova-compute[74233]: WARNING nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received unexpected event network-vif-plugged-d361737e-8157-4051-9970-4ac903ac279b for instance with vm_state active and task_state deleting.
Oct 20 18:18:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-a253b6e5-9a1d-4c9e-989a-00223f9680e7 req-5a6db391-3d93-456e-9041-d6ea4247b55d service nova] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Received event network-vif-deleted-d361737e-8157-4051-9970-4ac903ac279b {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:18:53 user nova-compute[74233]: INFO nova.compute.manager [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 18:18:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: dbb80f53-2ced-431d-9315-c911c6b72f4c] Deleting volume: 03601032-c5fc-4181-95bb-e1e278d2839d {{(pid=74233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 18:18:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:53 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:18:53 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:18:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:53 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Deleted allocations for instance dbb80f53-2ced-431d-9315-c911c6b72f4c
Oct 20 18:18:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-28133d67-a1c3-4ffc-84d0-38619ecd75d6 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "dbb80f53-2ced-431d-9315-c911c6b72f4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.887s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:18:56 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:56 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:56 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:56 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:18:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [{"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-95824943-b9d7-4a42-ba57-56ff4aad7142" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:18:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:19:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:19:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7562MB free_disk=25.074432373046875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c309386c-5cca-46e0-96b9-754e82d47e3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 69779d06-b30a-4986-a7ee-b7d365236f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance bae683b9-94e9-4e4f-9621-93c2410d2351 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:19:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:19:04 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:19:04 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:19:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:19:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-changed-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing instance network info cache due to event network-changed-b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG nova.network.neutron [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing network info cache for port b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:19:22 user nova-compute[74233]: INFO nova.compute.manager [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Rescuing
Oct 20 18:19:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:19:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG nova.network.neutron [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updating instance_info_cache with network_info: [{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG nova.network.neutron [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updated VIF entry in instance network info cache for port b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG nova.network.neutron [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d73742ba-e112-4a53-8115-c5fc6a70e54f req-048487fb-d987-45e9-8776-6beaf49f11f0 service nova] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG nova.compute.manager [req-92f7783d-b342-4e55-a764-fba42ff1d3ef req-082560dc-8767-4757-a17e-0c259beebcd2 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-92f7783d-b342-4e55-a764-fba42ff1d3ef req-082560dc-8767-4757-a17e-0c259beebcd2 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-92f7783d-b342-4e55-a764-fba42ff1d3ef req-082560dc-8767-4757-a17e-0c259beebcd2 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-92f7783d-b342-4e55-a764-fba42ff1d3ef req-082560dc-8767-4757-a17e-0c259beebcd2 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG nova.compute.manager [req-92f7783d-b342-4e55-a764-fba42ff1d3ef req-082560dc-8767-4757-a17e-0c259beebcd2 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:23 user nova-compute[74233]: WARNING nova.compute.manager [req-92f7783d-b342-4e55-a764-fba42ff1d3ef req-082560dc-8767-4757-a17e-0c259beebcd2 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-changed-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing instance network info cache due to event network-changed-b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG nova.network.neutron [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Refreshing network info cache for port b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:19:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance destroyed successfully.
Oct 20 18:19:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Attempting a stable device rescue
Oct 20 18:19:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:19:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Creating image(s)
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "/opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "/opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG nova.objects.instance [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'trusted_certs' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:24 user nova-compute[74233]: INFO nova.compute.manager [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Detaching volume 19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:25 user nova-compute[74233]: INFO nova.compute.manager [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Rescuing
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:19:25 user nova-compute[74233]: INFO nova.virt.block_device [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Attempting to driver detach volume 19627e31-7ae4-40ce-b918-f135c4fedae0 from mountpoint /dev/vdb
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Attempting to detach device vdb from instance 69779d06-b30a-4986-a7ee-b7d365236f77 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:19:25 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:19:25 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:19:25 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:19:25 user nova-compute[74233]:   <serial>19627e31-7ae4-40ce-b918-f135c4fedae0</serial>
Oct 20 18:19:25 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 18:19:25 user nova-compute[74233]: </disk>
Oct 20 18:19:25 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.virt.images [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] 40e2e8f9-a713-4f46-98ef-0350c839f785 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.part /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully detached device vdb from instance 69779d06-b30a-4986-a7ee-b7d365236f77 from the persistent domain config.
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69779d06-b30a-4986-a7ee-b7d365236f77 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:19:25 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:19:25 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:19:25 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:19:25 user nova-compute[74233]:   <serial>19627e31-7ae4-40ce-b918-f135c4fedae0</serial>
Oct 20 18:19:25 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 18:19:25 user nova-compute[74233]: </disk>
Oct 20 18:19:25 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-1b384bb2-1b29-40ae-9f86-34d91a6a6284 req-38c1be7d-a034-4a36-ab23-60b88c8ff46d service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1b384bb2-1b29-40ae-9f86-34d91a6a6284 req-38c1be7d-a034-4a36-ab23-60b88c8ff46d service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1b384bb2-1b29-40ae-9f86-34d91a6a6284 req-38c1be7d-a034-4a36-ab23-60b88c8ff46d service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1b384bb2-1b29-40ae-9f86-34d91a6a6284 req-38c1be7d-a034-4a36-ab23-60b88c8ff46d service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-1b384bb2-1b29-40ae-9f86-34d91a6a6284 req-38c1be7d-a034-4a36-ab23-60b88c8ff46d service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:25 user nova-compute[74233]: WARNING nova.compute.manager [req-1b384bb2-1b29-40ae-9f86-34d91a6a6284 req-38c1be7d-a034-4a36-ab23-60b88c8ff46d service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.network.neutron [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updated VIF entry in instance network info cache for port b2da9146-db38-4031-b048-53c42d4fe002. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG nova.network.neutron [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:19:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-adee3bc0-752c-44c8-ac3b-17af66260cdb req-35f9bd45-5e6d-4975-80da-286a13b6ca72 service nova] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.part /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.converted" returned: 0 in 0.429s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.network.neutron [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.910s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4 --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4,backing_fmt=raw /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4,backing_fmt=raw /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue" returned: 0 in 0.056s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'migration_context' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<bae683b9-94e9-4e4f-9621-93c2410d2351> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Start _get_guest_xml network_info=[{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "vif_mac": "fa:16:3e:50:9c:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40e2e8f9-a713-4f46-98ef-0350c839f785', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'd78e5244-99f5-4ef6-89f2-db6de093c695', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'bae683b9-94e9-4e4f-9621-93c2410d2351', 'attached_at': '', 'detached_at': '', 'volume_id': '2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'serial': '2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'resources' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<bae683b9-94e9-4e4f-9621-93c2410d2351> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'numa_topology' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<bae683b9-94e9-4e4f-9621-93c2410d2351> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:19:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:19:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'vcpu_model' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<bae683b9-94e9-4e4f-9621-93c2410d2351> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:19:26 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:19:26 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:19:26 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc6bab3-a912-4b01-80c0-dc052e4be5cf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VPFEiXjl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 18:19:26 user nova-compute[74233]: node.name = iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:19:26 user nova-compute[74233]: node.tpgt = -1
Oct 20 18:19:26 user nova-compute[74233]: node.startup = automatic
Oct 20 18:19:26 user nova-compute[74233]: node.leading_login = No
Oct 20 18:19:26 user nova-compute[74233]: iface.iscsi_ifacename = default
Oct 20 18:19:26 user nova-compute[74233]: iface.net_ifacename = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.ipaddress = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.prefix_len = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.hwaddress = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.transport_name = tcp
Oct 20 18:19:26 user nova-compute[74233]: iface.initiatorname = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.vlan_id = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.vlan_priority = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.vlan_state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.iface_num = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.mtu = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.port = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.bootproto = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.subnet_mask = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.gateway = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_alt_client_id = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_dns = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_learn_iqn = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_vendor_id_state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_vendor_id = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.dhcp_slp_da = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.fragmentation = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.gratuitous_arp = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.incoming_forwarding = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.tos_state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.tos = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.ttl = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.delayed_ack = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.tcp_nagle = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.tcp_wsf_state = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.tcp_wsf = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.tcp_timer_scale = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.tcp_timestamp = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.redirect = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.def_task_mgmt_timeout = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.header_digest = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.data_digest = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.immediate_data = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.initial_r2t = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.data_seq_inorder = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.data_pdu_inorder = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.erl = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.max_receive_data_len = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.first_burst_len = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.max_outstanding_r2t = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.max_burst_len = 0
Oct 20 18:19:26 user nova-compute[74233]: iface.chap_auth = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.bidi_chap = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.strict_login_compliance = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.discovery_auth = <empty>
Oct 20 18:19:26 user nova-compute[74233]: iface.discovery_logout = <empty>
Oct 20 18:19:26 user nova-compute[74233]: node.discovery_address = <empty>
Oct 20 18:19:26 user nova-compute[74233]: node.discovery_port = 0
Oct 20 18:19:26 user nova-compute[74233]: node.discovery_type = static
Oct 20 18:19:26 user nova-compute[74233]: node.session.initial_cmdsn = 0
Oct 20 18:19:26 user nova-compute[74233]: node.session.initial_login_retry_max = 8
Oct 20 18:19:26 user nova-compute[74233]: node.session.xmit_thread_priority = -20
Oct 20 18:19:26 user nova-compute[74233]: node.session.cmds_max = 128
Oct 20 18:19:26 user nova-compute[74233]: node.session.queue_depth = 32
Oct 20 18:19:26 user nova-compute[74233]: node.session.nr_sessions = 1
Oct 20 18:19:26 user nova-compute[74233]: node.session.auth.authmethod = CHAP
Oct 20 18:19:26 user nova-compute[74233]: node.session.auth.username = VPFEiXjl
Oct 20 18:19:26 user nova-compute[74233]: node.session.auth.password = ***
Oct 20 18:19:26 user nova-compute[74233]: node.session.auth.username_in = <empty>
Oct 20 18:19:26 user nova-compute[74233]: node.session.auth.password_in = <empty>
Oct 20 18:19:26 user nova-compute[74233]: node.session.auth.chap_algs = MD5
Oct 20 18:19:26 user nova-compute[74233]: node.session.timeo.replacement_timeout = 120
Oct 20 18:19:26 user nova-compute[74233]: node.session.err_timeo.abort_timeout = 15
Oct 20 18:19:26 user nova-compute[74233]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 18:19:26 user nova-compute[74233]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 18:19:26 user nova-compute[74233]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.FastAbort = Yes
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.InitialR2T = No
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.ImmediateData = Yes
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.MaxConnections = 1
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 18:19:26 user nova-compute[74233]: node.session.iscsi.ERL = 0
Oct 20 18:19:26 user nova-compute[74233]: node.session.scan = manual
Oct 20 18:19:26 user nova-compute[74233]: node.session.reopen_max = 0
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].address = 172.16.0.220
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].port = 3260
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].startup = manual
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].tcp.window_size = 524288
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].tcp.type_of_service = 0
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].timeo.logout_timeout = 15
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].timeo.login_timeout = 15
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].timeo.auth_timeout = 45
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].iscsi.DataDigest = None
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].iscsi.IFMarker = No
Oct 20 18:19:26 user nova-compute[74233]: node.conn[0].iscsi.OFMarker = No
Oct 20 18:19:26 user nova-compute[74233]: # END RECORD
Oct 20 18:19:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b0cd9-3e4c-4a8e-94d2-6427ee18a085]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f276f8d-f3e0-4660-bdda-d065372b2a3b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPFEiXjl {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPFEiXjl" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4957b0fd-ecf3-44fc-8ae9-8a8ca70dfd6f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPFEiXjl'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab28372-2a2f-4a77-903f-e42025351f60]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab0766-5866-4555-a5b2-8d7472c4e0cf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:19:26 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:19:26 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:19:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:19:26 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:19:26 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:19:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance destroyed successfully.
Oct 20 18:19:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Attempting rescue
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd05fa2-b174-4f2d-ad2b-73c482098ffb]: (4, ('0 0 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '26366393065333433', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366393065333433', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:19:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Creating image(s)
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839955891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839955891',id=25,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-n78n7z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:18:13Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=bae683b9-94e9-4e4f-9621-93c2410d2351,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "vif_mac": "fa:16:3e:50:9c:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "vif_mac": "fa:16:3e:50:9c:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:19:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'pci_devices' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.base [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Object Instance<bae683b9-94e9-4e4f-9621-93c2410d2351> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:19:27 user nova-compute[74233]:   <uuid>bae683b9-94e9-4e4f-9621-93c2410d2351</uuid>
Oct 20 18:19:27 user nova-compute[74233]:   <name>instance-00000019</name>
Oct 20 18:19:27 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:19:27 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:19:27 user nova-compute[74233]:   <metadata>
Oct 20 18:19:27 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:19:27 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1839955891</nova:name>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:19:26</nova:creationTime>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:19:27 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:19:27 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:owner>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:user uuid="a5149d5d6d1f486c87a0c808597a40f3">tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member</nova:user>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:project uuid="8c937ee3474848de8b761d88e32f6447">tempest-ServerBootFromVolumeStableRescueTest-481267461</nova:project>
Oct 20 18:19:27 user nova-compute[74233]:       </nova:owner>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:ports>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:port uuid="39e7f593-9184-4b4d-9108-cc0f096e1a57">
Oct 20 18:19:27 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 18:19:27 user nova-compute[74233]:         </nova:port>
Oct 20 18:19:27 user nova-compute[74233]:       </nova:ports>
Oct 20 18:19:27 user nova-compute[74233]:     </nova:instance>
Oct 20 18:19:27 user nova-compute[74233]:   </metadata>
Oct 20 18:19:27 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:19:27 user nova-compute[74233]:     <system>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="serial">bae683b9-94e9-4e4f-9621-93c2410d2351</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="uuid">bae683b9-94e9-4e4f-9621-93c2410d2351</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:19:27 user nova-compute[74233]:     </system>
Oct 20 18:19:27 user nova-compute[74233]:   </sysinfo>
Oct 20 18:19:27 user nova-compute[74233]:   <os>
Oct 20 18:19:27 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:19:27 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:19:27 user nova-compute[74233]:   </os>
Oct 20 18:19:27 user nova-compute[74233]:   <features>
Oct 20 18:19:27 user nova-compute[74233]:     <acpi/>
Oct 20 18:19:27 user nova-compute[74233]:     <apic/>
Oct 20 18:19:27 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:19:27 user nova-compute[74233]:   </features>
Oct 20 18:19:27 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:19:27 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:19:27 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:19:27 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:19:27 user nova-compute[74233]:   </clock>
Oct 20 18:19:27 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:19:27 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:19:27 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:19:27 user nova-compute[74233]:   </cpu>
Oct 20 18:19:27 user nova-compute[74233]:   <devices>
Oct 20 18:19:27 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:19:27 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:19:27 user nova-compute[74233]:       <source dev="/dev/sdd"/>
Oct 20 18:19:27 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:       <serial>2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3</serial>
Oct 20 18:19:27 user nova-compute[74233]:     </disk>
Oct 20 18:19:27 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:19:27 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:19:27 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue"/>
Oct 20 18:19:27 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:       <boot order="1"/>
Oct 20 18:19:27 user nova-compute[74233]:     </disk>
Oct 20 18:19:27 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:19:27 user nova-compute[74233]:       <mac address="fa:16:3e:50:9c:7a"/>
Oct 20 18:19:27 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:19:27 user nova-compute[74233]:       <target dev="tap39e7f593-91"/>
Oct 20 18:19:27 user nova-compute[74233]:     </interface>
Oct 20 18:19:27 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:19:27 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/console.log" append="off"/>
Oct 20 18:19:27 user nova-compute[74233]:     </serial>
Oct 20 18:19:27 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:19:27 user nova-compute[74233]:     <video>
Oct 20 18:19:27 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:     </video>
Oct 20 18:19:27 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:19:27 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:19:27 user nova-compute[74233]:     </rng>
Oct 20 18:19:27 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:19:27 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:19:27 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:19:27 user nova-compute[74233]:     </memballoon>
Oct 20 18:19:27 user nova-compute[74233]:   </devices>
Oct 20 18:19:27 user nova-compute[74233]: </domain>
Oct 20 18:19:27 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:19:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance destroyed successfully.
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] No VIF found with MAC fa:16:3e:50:9c:7a, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue" returned: 0 in 0.062s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'migration_context' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.base [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<dc2ea472-32aa-44bb-90e1-03062a4ec3f4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Start _get_guest_xml network_info=[{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:0a:67:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'resources' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.base [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<dc2ea472-32aa-44bb-90e1-03062a4ec3f4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'numa_topology' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.base [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<dc2ea472-32aa-44bb-90e1-03062a4ec3f4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:27 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:19:27 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.base [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<dc2ea472-32aa-44bb-90e1-03062a4ec3f4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1201958767',display_name='tempest-ServerRescueNegativeTestJSON-server-1201958767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1201958767',id=21,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-np33292u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:14:45Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=dc2ea472-32aa-44bb-90e1-03062a4ec3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:0a:67:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:0a:67:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'pci_devices' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.objects.base [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<dc2ea472-32aa-44bb-90e1-03062a4ec3f4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:19:27 user nova-compute[74233]:   <uuid>dc2ea472-32aa-44bb-90e1-03062a4ec3f4</uuid>
Oct 20 18:19:27 user nova-compute[74233]:   <name>instance-00000015</name>
Oct 20 18:19:27 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:19:27 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:19:27 user nova-compute[74233]:   <metadata>
Oct 20 18:19:27 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:19:27 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1201958767</nova:name>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:19:27</nova:creationTime>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:19:27 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:19:27 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:owner>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:user uuid="15b21695cdfe4b4299fb08403ed15ddd">tempest-ServerRescueNegativeTestJSON-226182355-project-member</nova:user>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:project uuid="51e847f3ff044181bb615138361ec8da">tempest-ServerRescueNegativeTestJSON-226182355</nova:project>
Oct 20 18:19:27 user nova-compute[74233]:       </nova:owner>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:19:27 user nova-compute[74233]:       <nova:ports>
Oct 20 18:19:27 user nova-compute[74233]:         <nova:port uuid="fb255a80-de0b-488a-b67a-946e1bd3dc98">
Oct 20 18:19:27 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 18:19:27 user nova-compute[74233]:         </nova:port>
Oct 20 18:19:27 user nova-compute[74233]:       </nova:ports>
Oct 20 18:19:27 user nova-compute[74233]:     </nova:instance>
Oct 20 18:19:27 user nova-compute[74233]:   </metadata>
Oct 20 18:19:27 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:19:27 user nova-compute[74233]:     <system>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="serial">dc2ea472-32aa-44bb-90e1-03062a4ec3f4</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="uuid">dc2ea472-32aa-44bb-90e1-03062a4ec3f4</entry>
Oct 20 18:19:27 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:19:27 user nova-compute[74233]:     </system>
Oct 20 18:19:27 user nova-compute[74233]:   </sysinfo>
Oct 20 18:19:27 user nova-compute[74233]:   <os>
Oct 20 18:19:27 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:19:27 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:19:27 user nova-compute[74233]:   </os>
Oct 20 18:19:27 user nova-compute[74233]:   <features>
Oct 20 18:19:27 user nova-compute[74233]:     <acpi/>
Oct 20 18:19:27 user nova-compute[74233]:     <apic/>
Oct 20 18:19:27 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:19:27 user nova-compute[74233]:   </features>
Oct 20 18:19:27 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:19:27 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:19:27 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:19:27 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:19:27 user nova-compute[74233]:   </clock>
Oct 20 18:19:27 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:19:27 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:19:27 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:19:27 user nova-compute[74233]:   </cpu>
Oct 20 18:19:27 user nova-compute[74233]:   <devices>
Oct 20 18:19:27 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:19:27 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:19:27 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue"/>
Oct 20 18:19:27 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:     </disk>
Oct 20 18:19:27 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:19:27 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:19:27 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk"/>
Oct 20 18:19:27 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:     </disk>
Oct 20 18:19:27 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:19:27 user nova-compute[74233]:       <mac address="fa:16:3e:0a:67:00"/>
Oct 20 18:19:27 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:19:27 user nova-compute[74233]:       <target dev="tapfb255a80-de"/>
Oct 20 18:19:27 user nova-compute[74233]:     </interface>
Oct 20 18:19:27 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:19:27 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/console.log" append="off"/>
Oct 20 18:19:27 user nova-compute[74233]:     </serial>
Oct 20 18:19:27 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:19:27 user nova-compute[74233]:     <video>
Oct 20 18:19:27 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:19:27 user nova-compute[74233]:     </video>
Oct 20 18:19:27 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:19:27 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:19:27 user nova-compute[74233]:     </rng>
Oct 20 18:19:27 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:19:27 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:19:27 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:19:27 user nova-compute[74233]:     </memballoon>
Oct 20 18:19:27 user nova-compute[74233]:   </devices>
Oct 20 18:19:27 user nova-compute[74233]: </domain>
Oct 20 18:19:27 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:19:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance destroyed successfully.
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:0a:67:00, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:27 user nova-compute[74233]: WARNING nova.compute.manager [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:27 user nova-compute[74233]: WARNING nova.compute.manager [req-27dadd4e-81a4-40be-9f3d-764ee672b828 req-ec93ec4b-af5b-4896-930a-d4e29cc6e0df service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:29 user nova-compute[74233]: WARNING nova.compute.manager [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:29 user nova-compute[74233]: WARNING nova.compute.manager [req-3e535c09-b945-4c4d-80db-31b87b008287 req-7e15c40b-0ebc-427e-b1ab-8afff2029eb5 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:32 user nova-compute[74233]: WARNING nova.compute.manager [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:32 user nova-compute[74233]: WARNING nova.compute.manager [req-576bb346-bafd-4a67-8872-4ab02fd475d1 req-2dccf0b7-6be2-450d-9b34-9b47a404bc07 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state active and task_state rescuing.
Oct 20 18:19:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-63bcbdf6-a0e5-4666-934b-92a8484cfed3 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:19:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7a926234-386e-48f6-9688-d26b51233d0b tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:19:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:19:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:19:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:19:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:19:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:19:46 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69779d06-b30a-4986-a7ee-b7d365236f77 is timed out.
Oct 20 18:19:46 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully detached device vdb from instance 69779d06-b30a-4986-a7ee-b7d365236f77 from the live domain config.
Oct 20 18:19:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGPkeMNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:19:46 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[094afb2d-ae03-4338-9ae5-4231db453103]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f85736f-7497-4b07-b16a-ca57c8e191bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:19:46 user nova-compute[74233]: No targets found.
Oct 20 18:19:46 user nova-compute[74233]: iSNS:
Oct 20 18:19:46 user nova-compute[74233]: No targets found.
Oct 20 18:19:46 user nova-compute[74233]: STATIC:
Oct 20 18:19:46 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:8f85736f-7497-4b07-b16a-ca57c8e191bd
Oct 20 18:19:46 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:19:46 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:19:46 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0
Oct 20 18:19:46 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:19:46 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:19:46 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:19:46 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:19:46 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:19:46 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:19:46 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:19:46 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:19:46 user nova-compute[74233]: FIRMWARE:
Oct 20 18:19:46 user nova-compute[74233]: No targets found.
Oct 20 18:19:46 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:19:46 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:19:46 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f7730-42a6-400a-93db-deb92b5549ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f85736f-7497-4b07-b16a-ca57c8e191bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd00beb-8aea-4ddc-92c0-2d8e7aefa03d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f85736f-7497-4b07-b16a-ca57c8e191bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:19:46 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:19:46 user nova-compute[74233]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f85736f-7497-4b07-b16a-ca57c8e191bd (non-flash)
Oct 20 18:19:46 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:19:46 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 (non-flash)
Oct 20 18:19:46 user nova-compute[74233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:19:46 user nova-compute[74233]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f85736f-7497-4b07-b16a-ca57c8e191bd (non-flash)
Oct 20 18:19:46 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:19:46 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950561480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0'): ({'sdh'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Removing single pathed devices sdh {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfe78e8-38ca-4814-b90a-a279bbe5e654]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dad72e-ae93-45aa-b2c0-2dfb1ff99b61]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flushing IO for device /dev/sdh {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba059b-b5ef-4a32-8957-c014bc687fcd]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[177dbcb1-321d-4a41-b3cb-6ebb836529e9]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fc9fdc-80d2-4010-81aa-001959efe069]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02171d5-59b8-4c84-8b51-f2eb42d7a9be]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260]
Oct 20 18:19:46 user nova-compute[74233]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0, portal: 172.16.0.220,3260] successful.
Oct 20 18:19:46 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19627e31-7ae4-40ce-b918-f135c4fedae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6275bbc-cadd-49ca-ae71-df31aee41802]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] <== disconnect_volume: return (350ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:19:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:19:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:49 user nova-compute[74233]: INFO nova.compute.manager [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Terminating instance
Oct 20 18:19:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0946154-a778-4ec5-b6a6-2416fb4de7d5 req-b97c5418-7fbe-4194-85b8-6f95a5dd32f7 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-vif-unplugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0946154-a778-4ec5-b6a6-2416fb4de7d5 req-b97c5418-7fbe-4194-85b8-6f95a5dd32f7 service nova] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0946154-a778-4ec5-b6a6-2416fb4de7d5 req-b97c5418-7fbe-4194-85b8-6f95a5dd32f7 service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0946154-a778-4ec5-b6a6-2416fb4de7d5 req-b97c5418-7fbe-4194-85b8-6f95a5dd32f7 service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0946154-a778-4ec5-b6a6-2416fb4de7d5 req-b97c5418-7fbe-4194-85b8-6f95a5dd32f7 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] No waiting events found dispatching network-vif-unplugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0946154-a778-4ec5-b6a6-2416fb4de7d5 req-b97c5418-7fbe-4194-85b8-6f95a5dd32f7 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-vif-unplugged-13d90459-841f-4f52-a89d-372094d65561 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:19:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Instance destroyed successfully.
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lazy-loading 'resources' on Instance uuid c309386c-5cca-46e0-96b9-754e82d47e3e {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-979855548',display_name='tempest-ServersNegativeTestJSON-server-979855548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-979855548',id=13,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d20ec6bba044fb8aff5094ac65ac52',ramdisk_id='',reservation_id='r-m0ui66aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-627903216',owner_user_name='tempest-ServersNegativeTestJSON-627903216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:10:41Z,user_data=None,user_id='02bbe839e32f41268676839457c3abbd',uuid=c309386c-5cca-46e0-96b9-754e82d47e3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converting VIF {"id": "13d90459-841f-4f52-a89d-372094d65561", "address": "fa:16:3e:b8:0f:e8", "network": {"id": "f2a101e4-0e36-48f9-b5fe-bac1a21dac4d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425722081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d20ec6bba044fb8aff5094ac65ac52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d90459-84", "ovs_interfaceid": "13d90459-841f-4f52-a89d-372094d65561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG os_vif [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13d90459-84, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a59ce6e1-5759-47e3-90d8-a7aa87d28304) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:50 user nova-compute[74233]: INFO os_vif [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:0f:e8,bridge_name='br-int',has_traffic_filtering=True,id=13d90459-841f-4f52-a89d-372094d65561,network=Network(f2a101e4-0e36-48f9-b5fe-bac1a21dac4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d90459-84')
Oct 20 18:19:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Deleting instance files /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e_del
Oct 20 18:19:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Deletion of /opt/stack/data/nova/instances/c309386c-5cca-46e0-96b9-754e82d47e3e_del complete
Oct 20 18:19:50 user nova-compute[74233]: INFO nova.compute.manager [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 18:19:50 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:19:50 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:19:51 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:19:51 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Took 0.52 seconds to deallocate network for instance.
Oct 20 18:19:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:51 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:19:51 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:19:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:52 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Deleted allocations for instance c309386c-5cca-46e0-96b9-754e82d47e3e
Oct 20 18:19:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4696bffd-9c42-46b7-bc1b-c3dd8b0029cf tempest-ServersNegativeTestJSON-627903216 tempest-ServersNegativeTestJSON-627903216-project-member] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.148s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] Acquiring lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] Lock "c309386c-5cca-46e0-96b9-754e82d47e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] No waiting events found dispatching network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:19:52 user nova-compute[74233]: WARNING nova.compute.manager [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received unexpected event network-vif-plugged-13d90459-841f-4f52-a89d-372094d65561 for instance with vm_state deleted and task_state None.
Oct 20 18:19:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-358dd8e7-4937-468f-b4ba-f8418ec36358 req-d5bd54e7-9ffc-4e70-b335-ef6c735e73d9 service nova] [instance: c309386c-5cca-46e0-96b9-754e82d47e3e] Received event network-vif-deleted-13d90459-841f-4f52-a89d-372094d65561 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:19:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:19:55 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:19:58 user nova-compute[74233]: DEBUG nova.objects.instance [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'flavor' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:19:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19932308-8817-411c-a50a-3f8306c80ab5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.978s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:19:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:20:01 user nova-compute[74233]: INFO nova.compute.claims [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Claim successful on node user
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.policy [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10447188fbd74b18ba64fc8e64d267c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b592b103d8084815bf6d3132c1215feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:20:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:20:02 user nova-compute[74233]: INFO nova.virt.block_device [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Booting with volume 78618bd9-1c8d-4076-a12e-651178361bf2 at /dev/vda
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG os_brick.utils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54932daa-77f3-49d0-b9d0-629d63eb281c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[353b3c91-e1b7-4f3c-aa9b-3215ffe5534a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c5c94-5da5-4123-97d7-e4dfea96a3be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8932d42-3073-4ea6-afe7-e40c90cb8188]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:20:02 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e903b44-119d-403b-85cd-585404b0050e]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG os_brick.utils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updating existing volume attachment record: 6db39673-5343-4258-b4ec-17f558691ecc {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Successfully created port: ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Successfully updated port: ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquired lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-changed-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Refreshing instance network info cache due to event network-changed-ab368db6-e76a-4cea-817d-3f097d84fb49. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] Acquiring lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updating instance_info_cache with network_info: [{"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Releasing lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Instance network_info: |[{"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] Acquired lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Refreshing network info cache for port ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:04 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:20:04 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=24.990840911865234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 69779d06-b30a-4986-a7ee-b7d365236f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance bae683b9-94e9-4e4f-9621-93c2410d2351 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updated VIF entry in instance network info cache for port ab368db6-e76a-4cea-817d-3f097d84fb49. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updating instance_info_cache with network_info: [{"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8d6a91e5-b161-49ed-8d3e-bbba6bcb641c req-4ea54155-9b93-4139-be5c-54ff22fccc28 service nova] Releasing lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:20:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:05 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [{"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-69779d06-b30a-4986-a7ee-b7d365236f77" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-changed-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Refreshing instance network info cache due to event network-changed-6d5340b7-026b-4367-bf48-c710ffca8ace. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Refreshing network info cache for port 6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated VIF entry in instance network info cache for port 6d5340b7-026b-4367-bf48-c710ffca8ace. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b7f90405-4600-4c07-b122-c07b2fecf0a3 req-17987666-277b-4de2-8921-f4abad1c8cb0 service nova] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-changed-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Refreshing instance network info cache due to event network-changed-6b4ef092-a79c-40e6-98a2-e6a45f6044c3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:20:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:29 user nova-compute[74233]: DEBUG nova.network.neutron [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Refreshing network info cache for port 6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updated VIF entry in instance network info cache for port 6b4ef092-a79c-40e6-98a2-e6a45f6044c3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-66f62d10-0004-4529-838f-710dccc17941 req-01d8cca3-a48a-4037-a083-4eefbfd993cc service nova] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:20:30 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Creating image(s)
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Ensure instance console log exists: /opt/stack/data/nova/instances/4aa2830b-d7e0-4e15-afc5-285cf3ca2f53/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Start _get_guest_xml network_info=[{"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6db39673-5343-4258-b4ec-17f558691ecc', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4aa2830b-d7e0-4e15-afc5-285cf3ca2f53', 'attached_at': '', 'detached_at': '', 'volume_id': '78618bd9-1c8d-4076-a12e-651178361bf2', 'serial': '78618bd9-1c8d-4076-a12e-651178361bf2'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:20:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:20:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:20:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:20:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:20:30 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c70fabc-d349-4acd-b5ec-15c8f094d820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:20:30 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8bbf63-da9f-4096-a397-f6e0ab0691f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2] added
Oct 20 18:20:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0f37e1-6778-46ec-9135-0af6f3b7aaa8]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4676cb-9972-466f-b441-8ea0ae44d211]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZOVJFyo {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZOVJFyo" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d3397-a3c8-4005-aa20-e7739fa56103]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fZOVJFyo'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bdd9b2-b2f4-4fd9-a120-546aecab85b7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130041b-fa55-48d2-b982-c92efc50877f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a616013-b929-46de-a5bc-6ce9bf676af7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]
Oct 20 18:20:30 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.
Oct 20 18:20:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9134dc2-ef26-4cc2-a30b-3830ee5c4ec8]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cad89b-d261-4372-a372-f90d7d193e44]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:20:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac9c100-8dbb-4325-a218-f782a72d162a]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:20:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:31 user nova-compute[74233]: INFO nova.compute.manager [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Terminating instance
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-19aa319a-ffd3-4c47-9212-f52a4100b279 req-f602d99d-2e1c-4f2b-8c4b-0b6f8a84d88f service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-unplugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-19aa319a-ffd3-4c47-9212-f52a4100b279 req-f602d99d-2e1c-4f2b-8c4b-0b6f8a84d88f service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-19aa319a-ffd3-4c47-9212-f52a4100b279 req-f602d99d-2e1c-4f2b-8c4b-0b6f8a84d88f service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-19aa319a-ffd3-4c47-9212-f52a4100b279 req-f602d99d-2e1c-4f2b-8c4b-0b6f8a84d88f service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-19aa319a-ffd3-4c47-9212-f52a4100b279 req-f602d99d-2e1c-4f2b-8c4b-0b6f8a84d88f service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-unplugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-19aa319a-ffd3-4c47-9212-f52a4100b279 req-f602d99d-2e1c-4f2b-8c4b-0b6f8a84d88f service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-unplugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23634613631313966', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613631313966', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:20:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Instance destroyed successfully.
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'resources' on Instance uuid 69779d06-b30a-4986-a7ee-b7d365236f77 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1391362163',display_name='tempest-TestMinimumBasicScenario-server-1391362163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1391362163',id=19,image_ref='78a60768-e10c-41c2-a821-2dea067b1501',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTkMoRSQXY+jyqTWauF0wzef2Z+CWqAlh3BrEaFOkDDuAiMmOfOzBHfpez7VQwr7bsIxrYYA6Taq3GGVDAFJfy2aNRwzVvqB+piX+GPwaWljU80xinC68nnlHoyShT5uA==',key_name='tempest-TestMinimumBasicScenario-393850783',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-lqnau87h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='78a60768-e10c-41c2-a821-2dea067b1501',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:17:38Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=69779d06-b30a-4986-a7ee-b7d365236f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "b2da9146-db38-4031-b048-53c42d4fe002", "address": "fa:16:3e:d2:f5:f0", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2da9146-db", "ovs_interfaceid": "b2da9146-db38-4031-b048-53c42d4fe002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG os_vif [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1353402674',display_name='tempest-TestVolumeBootPattern-server-1353402674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1353402674',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-4tb9na0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:20:02Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=4aa2830b-d7e0-4e15-afc5-285cf3ca2f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2da9146-db, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec5bde0b-5473-416c-93f3-1e09212f7737) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:20:31 user nova-compute[74233]:   <uuid>4aa2830b-d7e0-4e15-afc5-285cf3ca2f53</uuid>
Oct 20 18:20:31 user nova-compute[74233]:   <name>instance-0000001c</name>
Oct 20 18:20:31 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:20:31 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:20:31 user nova-compute[74233]:   <metadata>
Oct 20 18:20:31 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:20:31 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:20:31 user nova-compute[74233]:       <nova:name>tempest-TestVolumeBootPattern-server-1353402674</nova:name>
Oct 20 18:20:31 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:20:30</nova:creationTime>
Oct 20 18:20:31 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:20:31 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:20:31 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:20:31 user nova-compute[74233]:       <nova:owner>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:user uuid="10447188fbd74b18ba64fc8e64d267c6">tempest-TestVolumeBootPattern-2006411708-project-member</nova:user>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:project uuid="b592b103d8084815bf6d3132c1215feb">tempest-TestVolumeBootPattern-2006411708</nova:project>
Oct 20 18:20:31 user nova-compute[74233]:       </nova:owner>
Oct 20 18:20:31 user nova-compute[74233]:       <nova:ports>
Oct 20 18:20:31 user nova-compute[74233]:         <nova:port uuid="ab368db6-e76a-4cea-817d-3f097d84fb49">
Oct 20 18:20:31 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 18:20:31 user nova-compute[74233]:         </nova:port>
Oct 20 18:20:31 user nova-compute[74233]:       </nova:ports>
Oct 20 18:20:31 user nova-compute[74233]:     </nova:instance>
Oct 20 18:20:31 user nova-compute[74233]:   </metadata>
Oct 20 18:20:31 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:20:31 user nova-compute[74233]:     <system>
Oct 20 18:20:31 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:20:31 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:20:31 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:20:31 user nova-compute[74233]:       <entry name="serial">4aa2830b-d7e0-4e15-afc5-285cf3ca2f53</entry>
Oct 20 18:20:31 user nova-compute[74233]:       <entry name="uuid">4aa2830b-d7e0-4e15-afc5-285cf3ca2f53</entry>
Oct 20 18:20:31 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:20:31 user nova-compute[74233]:     </system>
Oct 20 18:20:31 user nova-compute[74233]:   </sysinfo>
Oct 20 18:20:31 user nova-compute[74233]:   <os>
Oct 20 18:20:31 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:20:31 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:20:31 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:20:31 user nova-compute[74233]:   </os>
Oct 20 18:20:31 user nova-compute[74233]:   <features>
Oct 20 18:20:31 user nova-compute[74233]:     <acpi/>
Oct 20 18:20:31 user nova-compute[74233]:     <apic/>
Oct 20 18:20:31 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:20:31 user nova-compute[74233]:   </features>
Oct 20 18:20:31 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:20:31 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:20:31 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:20:31 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:20:31 user nova-compute[74233]:   </clock>
Oct 20 18:20:31 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:20:31 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:20:31 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:20:31 user nova-compute[74233]:   </cpu>
Oct 20 18:20:31 user nova-compute[74233]:   <devices>
Oct 20 18:20:31 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:20:31 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:20:31 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:20:31 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:20:31 user nova-compute[74233]:       <serial>78618bd9-1c8d-4076-a12e-651178361bf2</serial>
Oct 20 18:20:31 user nova-compute[74233]:     </disk>
Oct 20 18:20:31 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:20:31 user nova-compute[74233]:       <mac address="fa:16:3e:b5:0c:86"/>
Oct 20 18:20:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:20:31 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:20:31 user nova-compute[74233]:       <target dev="tapab368db6-e7"/>
Oct 20 18:20:31 user nova-compute[74233]:     </interface>
Oct 20 18:20:31 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:20:31 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/4aa2830b-d7e0-4e15-afc5-285cf3ca2f53/console.log" append="off"/>
Oct 20 18:20:31 user nova-compute[74233]:     </serial>
Oct 20 18:20:31 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:20:31 user nova-compute[74233]:     <video>
Oct 20 18:20:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:20:31 user nova-compute[74233]:     </video>
Oct 20 18:20:31 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:20:31 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:20:31 user nova-compute[74233]:     </rng>
Oct 20 18:20:31 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:20:31 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:20:31 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:20:31 user nova-compute[74233]:     </memballoon>
Oct 20 18:20:31 user nova-compute[74233]:   </devices>
Oct 20 18:20:31 user nova-compute[74233]: </domain>
Oct 20 18:20:31 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1353402674',display_name='tempest-TestVolumeBootPattern-server-1353402674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1353402674',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-4tb9na0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:20:02Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=4aa2830b-d7e0-4e15-afc5-285cf3ca2f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG os_vif [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e53460ee-d11d-51be-b5b7-584f0e2b9376', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: INFO os_vif [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2da9146-db38-4031-b048-53c42d4fe002,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2da9146-db')
Oct 20 18:20:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Deleting instance files /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77_del
Oct 20 18:20:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Deletion of /opt/stack/data/nova/instances/69779d06-b30a-4986-a7ee-b7d365236f77_del complete
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab368db6-e7, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab368db6-e7, col_values=(('qos', UUID('0e3baaa3-43df-4e6d-a66e-f742643bcb72')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab368db6-e7, col_values=(('external_ids', {'iface-id': 'ab368db6-e76a-4cea-817d-3f097d84fb49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:0c:86', 'vm-uuid': '4aa2830b-d7e0-4e15-afc5-285cf3ca2f53'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:20:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:31 user nova-compute[74233]: INFO os_vif [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7')
Oct 20 18:20:32 user nova-compute[74233]: INFO nova.compute.manager [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 18:20:32 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No VIF found with MAC fa:16:3e:b5:0c:86, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:32 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Took 0.53 seconds to deallocate network for instance.
Oct 20 18:20:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-43c139fd-4c67-4cfc-9023-1481b5882ff6 req-5197d563-72e9-415b-86ae-4b4a441830fd service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-deleted-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:33 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Deleted allocations for instance 69779d06-b30a-4986-a7ee-b7d365236f77
Oct 20 18:20:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-afe0d3d5-8b3c-40de-9e2e-2e84512ad3c3 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "69779d06-b30a-4986-a7ee-b7d365236f77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-d172a5a7-cf58-4235-9b04-5a8ce85c408e req-9f23ec36-863b-4d62-834b-0cfde8bd8361 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d172a5a7-cf58-4235-9b04-5a8ce85c408e req-9f23ec36-863b-4d62-834b-0cfde8bd8361 service nova] Acquiring lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d172a5a7-cf58-4235-9b04-5a8ce85c408e req-9f23ec36-863b-4d62-834b-0cfde8bd8361 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d172a5a7-cf58-4235-9b04-5a8ce85c408e req-9f23ec36-863b-4d62-834b-0cfde8bd8361 service nova] Lock "69779d06-b30a-4986-a7ee-b7d365236f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-d172a5a7-cf58-4235-9b04-5a8ce85c408e req-9f23ec36-863b-4d62-834b-0cfde8bd8361 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] No waiting events found dispatching network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:20:33 user nova-compute[74233]: WARNING nova.compute.manager [req-d172a5a7-cf58-4235-9b04-5a8ce85c408e req-9f23ec36-863b-4d62-834b-0cfde8bd8361 service nova] [instance: 69779d06-b30a-4986-a7ee-b7d365236f77] Received unexpected event network-vif-plugged-b2da9146-db38-4031-b048-53c42d4fe002 for instance with vm_state deleted and task_state None.
Oct 20 18:20:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-897b147e-e620-41cf-b802-e02452f74407 req-b569e3cd-2c71-4b3b-a5bc-6c191f4cc589 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-897b147e-e620-41cf-b802-e02452f74407 req-b569e3cd-2c71-4b3b-a5bc-6c191f4cc589 service nova] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-897b147e-e620-41cf-b802-e02452f74407 req-b569e3cd-2c71-4b3b-a5bc-6c191f4cc589 service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-897b147e-e620-41cf-b802-e02452f74407 req-b569e3cd-2c71-4b3b-a5bc-6c191f4cc589 service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-897b147e-e620-41cf-b802-e02452f74407 req-b569e3cd-2c71-4b3b-a5bc-6c191f4cc589 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] No waiting events found dispatching network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:20:34 user nova-compute[74233]: WARNING nova.compute.manager [req-897b147e-e620-41cf-b802-e02452f74407 req-b569e3cd-2c71-4b3b-a5bc-6c191f4cc589 service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received unexpected event network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 for instance with vm_state building and task_state spawning.
Oct 20 18:20:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:20:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Instance spawned successfully.
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:20:35 user nova-compute[74233]: INFO nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 20 18:20:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:20:35 user nova-compute[74233]: INFO nova.compute.manager [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Took 34.78 seconds to build instance.
Oct 20 18:20:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b5714381-f408-4748-9bc9-e77cfba5f14d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.893s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-89a98b7c-d8ce-43ed-ba78-2e116a8a09a5 req-d4daebfb-7d73-4f77-879c-a5a5fa8b592a service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-89a98b7c-d8ce-43ed-ba78-2e116a8a09a5 req-d4daebfb-7d73-4f77-879c-a5a5fa8b592a service nova] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-89a98b7c-d8ce-43ed-ba78-2e116a8a09a5 req-d4daebfb-7d73-4f77-879c-a5a5fa8b592a service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-89a98b7c-d8ce-43ed-ba78-2e116a8a09a5 req-d4daebfb-7d73-4f77-879c-a5a5fa8b592a service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-89a98b7c-d8ce-43ed-ba78-2e116a8a09a5 req-d4daebfb-7d73-4f77-879c-a5a5fa8b592a service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] No waiting events found dispatching network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:20:36 user nova-compute[74233]: WARNING nova.compute.manager [req-89a98b7c-d8ce-43ed-ba78-2e116a8a09a5 req-d4daebfb-7d73-4f77-879c-a5a5fa8b592a service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received unexpected event network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 for instance with vm_state active and task_state None.
Oct 20 18:20:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:20:43 user nova-compute[74233]: INFO nova.compute.claims [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Claim successful on node user
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:20:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:20:43 user nova-compute[74233]: INFO nova.virt.block_device [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Booting with volume 600c0d7b-697c-467c-8d7e-061bd4cb2509 at /dev/vda
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.policy [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9207f9f82e346ec86d29521dc93e221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f91646be9384ebdab36bc6c813cb56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG os_brick.utils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd03935-c109-4468-8cf0-1e4e0373f4b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b263f-4731-4910-bd3f-5a0a4f23f26d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db682399-6268-443d-a1d7-50bb4aa062d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eedb09-af84-4b87-a160-f0b764e1da98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:20:43 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:20:43 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af0921-aa95-42ca-850d-a98648a889d4]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG os_brick.utils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:20:43 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updating existing volume attachment record: ac8d1fa0-c008-4b88-a28b-7f76ee178cf7 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:20:44 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Successfully created port: de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Successfully updated port: de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquired lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-changed-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Refreshing instance network info cache due to event network-changed-de94c390-2e4c-4ea8-9456-e9f8b242a745. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] Acquiring lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.network.neutron [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updating instance_info_cache with network_info: [{"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Releasing lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance network_info: |[{"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] Acquired lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:20:45 user nova-compute[74233]: DEBUG nova.network.neutron [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Refreshing network info cache for port de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:20:46 user nova-compute[74233]: DEBUG nova.network.neutron [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updated VIF entry in instance network info cache for port de94c390-2e4c-4ea8-9456-e9f8b242a745. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:20:46 user nova-compute[74233]: DEBUG nova.network.neutron [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updating instance_info_cache with network_info: [{"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:20:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6ad139a0-0b5a-46e3-9550-802129160893 req-52144754-a1b7-42e9-987c-41a1203b38ad service nova] Releasing lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:20:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:20:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:20:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:20:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:00 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:21:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Creating image(s)
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Ensure instance console log exists: /opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Start _get_guest_xml network_info=[{"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'ac8d1fa0-c008-4b88-a28b-7f76ee178cf7', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'debfd120-e237-4afa-9b36-2bed99e48379', 'attached_at': '', 'detached_at': '', 'volume_id': '600c0d7b-697c-467c-8d7e-061bd4cb2509', 'serial': '600c0d7b-697c-467c-8d7e-061bd4cb2509'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:21:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:21:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:21:02 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:21:02 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:21:02 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f499329c-ba9a-460f-85a0-0c68b0d45b3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:21:02 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886d61e-efe2-4b67-9835-be7497f5a5cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509] added
Oct 20 18:21:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c84663-d343-4437-a387-01b7a879acd0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d818ee7-6193-4890-ab70-1940f3f46eb6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWNCtKLR {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWNCtKLR" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5583bb-1c71-46ba-b9d7-89764016ba46]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWNCtKLR'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[331932f4-eac7-4bb9-9461-4f66cdab2c7d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efeea28-b9d3-433d-bdb3-289834603d43]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[829df403-2272-42ff-a1f6-4c4c91130f9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]
Oct 20 18:21:02 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.
Oct 20 18:21:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce2167-5599-48db-9847-7a129431654d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebf727a-7438-4b5f-9a1e-996c25e0b3a7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:21:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a6dae7-a3bf-4bf3-a9ed-e39c94edbcdf]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23962346130373234', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962346130373234', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-382179192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382179192',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdxvKw/u2/yYNcSmoIIw3OhtKwd9N5pLEhMwvhcYInn0YmmQEqlhhtUrpuAHa9qB1NKrhaBPRWW5SC94JQy/O/YrBBmdOi7KhyHAC4xFBV4fmIstcf3tZGhxFTrqMLAA==',key_name='tempest-keypair-1819207714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f91646be9384ebdab36bc6c813cb56e',ramdisk_id='',reservation_id='r-0l0w4hia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1458618408',owner_user_name='tempest-ServerActionsV293TestJSON-1458618408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9207f9f82e346ec86d29521dc93e221',uuid=debfd120-e237-4afa-9b36-2bed99e48379,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converting VIF {"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lazy-loading 'pci_devices' on Instance uuid debfd120-e237-4afa-9b36-2bed99e48379 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:21:03 user nova-compute[74233]:   <uuid>debfd120-e237-4afa-9b36-2bed99e48379</uuid>
Oct 20 18:21:03 user nova-compute[74233]:   <name>instance-0000001d</name>
Oct 20 18:21:03 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:21:03 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:21:03 user nova-compute[74233]:   <metadata>
Oct 20 18:21:03 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:21:03 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:21:03 user nova-compute[74233]:       <nova:name>tempest-ServerActionsV293TestJSON-server-382179192</nova:name>
Oct 20 18:21:03 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:21:02</nova:creationTime>
Oct 20 18:21:03 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:21:03 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:21:03 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:21:03 user nova-compute[74233]:       <nova:owner>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:user uuid="b9207f9f82e346ec86d29521dc93e221">tempest-ServerActionsV293TestJSON-1458618408-project-member</nova:user>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:project uuid="1f91646be9384ebdab36bc6c813cb56e">tempest-ServerActionsV293TestJSON-1458618408</nova:project>
Oct 20 18:21:03 user nova-compute[74233]:       </nova:owner>
Oct 20 18:21:03 user nova-compute[74233]:       <nova:ports>
Oct 20 18:21:03 user nova-compute[74233]:         <nova:port uuid="de94c390-2e4c-4ea8-9456-e9f8b242a745">
Oct 20 18:21:03 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:21:03 user nova-compute[74233]:         </nova:port>
Oct 20 18:21:03 user nova-compute[74233]:       </nova:ports>
Oct 20 18:21:03 user nova-compute[74233]:     </nova:instance>
Oct 20 18:21:03 user nova-compute[74233]:   </metadata>
Oct 20 18:21:03 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:21:03 user nova-compute[74233]:     <system>
Oct 20 18:21:03 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:21:03 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:21:03 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:21:03 user nova-compute[74233]:       <entry name="serial">debfd120-e237-4afa-9b36-2bed99e48379</entry>
Oct 20 18:21:03 user nova-compute[74233]:       <entry name="uuid">debfd120-e237-4afa-9b36-2bed99e48379</entry>
Oct 20 18:21:03 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:21:03 user nova-compute[74233]:     </system>
Oct 20 18:21:03 user nova-compute[74233]:   </sysinfo>
Oct 20 18:21:03 user nova-compute[74233]:   <os>
Oct 20 18:21:03 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:21:03 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:21:03 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:21:03 user nova-compute[74233]:   </os>
Oct 20 18:21:03 user nova-compute[74233]:   <features>
Oct 20 18:21:03 user nova-compute[74233]:     <acpi/>
Oct 20 18:21:03 user nova-compute[74233]:     <apic/>
Oct 20 18:21:03 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:21:03 user nova-compute[74233]:   </features>
Oct 20 18:21:03 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:21:03 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:21:03 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:21:03 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:21:03 user nova-compute[74233]:   </clock>
Oct 20 18:21:03 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:21:03 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:21:03 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:21:03 user nova-compute[74233]:   </cpu>
Oct 20 18:21:03 user nova-compute[74233]:   <devices>
Oct 20 18:21:03 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:21:03 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:21:03 user nova-compute[74233]:       <source dev="/dev/sde"/>
Oct 20 18:21:03 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:21:03 user nova-compute[74233]:       <serial>600c0d7b-697c-467c-8d7e-061bd4cb2509</serial>
Oct 20 18:21:03 user nova-compute[74233]:     </disk>
Oct 20 18:21:03 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:21:03 user nova-compute[74233]:       <mac address="fa:16:3e:c7:a1:39"/>
Oct 20 18:21:03 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:21:03 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:21:03 user nova-compute[74233]:       <target dev="tapde94c390-2e"/>
Oct 20 18:21:03 user nova-compute[74233]:     </interface>
Oct 20 18:21:03 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:21:03 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379/console.log" append="off"/>
Oct 20 18:21:03 user nova-compute[74233]:     </serial>
Oct 20 18:21:03 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:21:03 user nova-compute[74233]:     <video>
Oct 20 18:21:03 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:21:03 user nova-compute[74233]:     </video>
Oct 20 18:21:03 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:21:03 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:21:03 user nova-compute[74233]:     </rng>
Oct 20 18:21:03 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:21:03 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:21:03 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:21:03 user nova-compute[74233]:     </memballoon>
Oct 20 18:21:03 user nova-compute[74233]:   </devices>
Oct 20 18:21:03 user nova-compute[74233]: </domain>
Oct 20 18:21:03 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-382179192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382179192',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdxvKw/u2/yYNcSmoIIw3OhtKwd9N5pLEhMwvhcYInn0YmmQEqlhhtUrpuAHa9qB1NKrhaBPRWW5SC94JQy/O/YrBBmdOi7KhyHAC4xFBV4fmIstcf3tZGhxFTrqMLAA==',key_name='tempest-keypair-1819207714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f91646be9384ebdab36bc6c813cb56e',ramdisk_id='',reservation_id='r-0l0w4hia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1458618408',owner_user_name='tempest-ServerActionsV293TestJSON-1458618408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9207f9f82e346ec86d29521dc93e221',uuid=debfd120-e237-4afa-9b36-2bed99e48379,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converting VIF {"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG os_vif [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac993ce2-a75f-5c84-af00-e743c37baec6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde94c390-2e, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde94c390-2e, col_values=(('qos', UUID('33e95d12-ccf2-4960-b45a-fea47f4d72a5')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde94c390-2e, col_values=(('external_ids', {'iface-id': 'de94c390-2e4c-4ea8-9456-e9f8b242a745', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:a1:39', 'vm-uuid': 'debfd120-e237-4afa-9b36-2bed99e48379'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:03 user nova-compute[74233]: INFO os_vif [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e')
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] No VIF found with MAC fa:16:3e:c7:a1:39, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:21:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:21:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7845MB free_disk=25.00537872314453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance bae683b9-94e9-4e4f-9621-93c2410d2351 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance debfd120-e237-4afa-9b36-2bed99e48379 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-3c2368fc-8e9b-4169-9341-99f9947ad491 req-808c738a-e2b2-4705-a314-3ba0c4da2b58 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3c2368fc-8e9b-4169-9341-99f9947ad491 req-808c738a-e2b2-4705-a314-3ba0c4da2b58 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3c2368fc-8e9b-4169-9341-99f9947ad491 req-808c738a-e2b2-4705-a314-3ba0c4da2b58 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3c2368fc-8e9b-4169-9341-99f9947ad491 req-808c738a-e2b2-4705-a314-3ba0c4da2b58 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-3c2368fc-8e9b-4169-9341-99f9947ad491 req-808c738a-e2b2-4705-a314-3ba0c4da2b58 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:05 user nova-compute[74233]: WARNING nova.compute.manager [req-3c2368fc-8e9b-4169-9341-99f9947ad491 req-808c738a-e2b2-4705-a314-3ba0c4da2b58 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state building and task_state spawning.
Oct 20 18:21:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:21:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:21:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:21:06 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Updating instance_info_cache with network_info: [{"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-7bdc323f-b8a2-4924-86bf-b35b1d680027" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:21:07 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance spawned successfully.
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-291a999a-ed12-4b5a-b5e7-ec290b70d1ae req-0b44aeda-d0a5-43f9-8985-f2a277269e43 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-291a999a-ed12-4b5a-b5e7-ec290b70d1ae req-0b44aeda-d0a5-43f9-8985-f2a277269e43 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-291a999a-ed12-4b5a-b5e7-ec290b70d1ae req-0b44aeda-d0a5-43f9-8985-f2a277269e43 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-291a999a-ed12-4b5a-b5e7-ec290b70d1ae req-0b44aeda-d0a5-43f9-8985-f2a277269e43 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-291a999a-ed12-4b5a-b5e7-ec290b70d1ae req-0b44aeda-d0a5-43f9-8985-f2a277269e43 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:07 user nova-compute[74233]: WARNING nova.compute.manager [req-291a999a-ed12-4b5a-b5e7-ec290b70d1ae req-0b44aeda-d0a5-43f9-8985-f2a277269e43 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state building and task_state spawning.
Oct 20 18:21:07 user nova-compute[74233]: INFO nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Took 5.16 seconds to spawn the instance on the hypervisor.
Oct 20 18:21:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:21:07 user nova-compute[74233]: INFO nova.compute.manager [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Took 24.56 seconds to build instance.
Oct 20 18:21:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e08d0087-c3cc-4c35-a30d-87440a4ee7f2 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.024s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:13 user nova-compute[74233]: INFO nova.compute.manager [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Unrescuing
Oct 20 18:21:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:21:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquired lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:21:13 user nova-compute[74233]: DEBUG nova.network.neutron [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:21:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG nova.network.neutron [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updating instance_info_cache with network_info: [{"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Releasing lock "refresh_cache-bae683b9-94e9-4e4f-9621-93c2410d2351" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG nova.objects.instance [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'flavor' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-f99a1033-268f-4e6e-a216-41152e4e302a req-97416001-4d49-4c54-a887-bbcc914c47c2 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f99a1033-268f-4e6e-a216-41152e4e302a req-97416001-4d49-4c54-a887-bbcc914c47c2 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f99a1033-268f-4e6e-a216-41152e4e302a req-97416001-4d49-4c54-a887-bbcc914c47c2 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f99a1033-268f-4e6e-a216-41152e4e302a req-97416001-4d49-4c54-a887-bbcc914c47c2 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-f99a1033-268f-4e6e-a216-41152e4e302a req-97416001-4d49-4c54-a887-bbcc914c47c2 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:14 user nova-compute[74233]: WARNING nova.compute.manager [req-f99a1033-268f-4e6e-a216-41152e4e302a req-97416001-4d49-4c54-a887-bbcc914c47c2 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance destroyed successfully.
Oct 20 18:21:16 user nova-compute[74233]: INFO nova.compute.manager [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Unrescuing
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:16 user nova-compute[74233]: WARNING nova.compute.manager [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:16 user nova-compute[74233]: WARNING nova.compute.manager [req-50a0b018-858f-4299-884b-697957d62098 req-09a2fe06-c0d5-4f01-a899-9d6f9d50594f service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'flavor' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:17 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance destroyed successfully.
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-5dc87b81-e3ce-4f4d-9ce6-6ea00d65ce05 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:18 user nova-compute[74233]: WARNING nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:18 user nova-compute[74233]: WARNING nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:18 user nova-compute[74233]: WARNING nova.compute.manager [req-22ff47b8-07d2-40cb-aad9-9830bc652070 req-491b3e7e-597e-4677-b300-bebf53b30661 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:20 user nova-compute[74233]: WARNING nova.compute.manager [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:20 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:20 user nova-compute[74233]: WARNING nova.compute.manager [req-fa62cd8c-3daa-4620-baba-6bbc36896a9e req-194b099b-9623-4a4c-9f32-6c18129ccea9 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:21:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8ecf97dd-39fd-4a30-9c16-bfa892eef3a8 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:21:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:21:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:27 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:21:27 user nova-compute[74233]: INFO nova.compute.claims [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Claim successful on node user
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:21:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.policy [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50fe59facf744cf5b860e3b60995c05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d191f70cfa47cfbf249e5a33695689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:21:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Creating image(s)
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "/opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "/opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "c0536f94860f4c27480697b21f791dbab919bc60" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "c0536f94860f4c27480697b21f791dbab919bc60" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Successfully created port: 4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.part --force-share --output=json" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.virt.images [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] 955ca178-1253-4ff1-960e-38f2de9eb9ca was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.part /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.part /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.converted" returned: 0 in 0.353s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "c0536f94860f4c27480697b21f791dbab919bc60" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Successfully updated port: 4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "refresh_cache-5b5e15d0-98d8-4f35-98ff-41e922792b05" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquired lock "refresh_cache-5b5e15d0-98d8-4f35-98ff-41e922792b05" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-changed-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Refreshing instance network info cache due to event network-changed-4c5656c6-8f29-40ac-b14b-f313865a800d. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] Acquiring lock "refresh_cache-5b5e15d0-98d8-4f35-98ff-41e922792b05" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "c0536f94860f4c27480697b21f791dbab919bc60" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "c0536f94860f4c27480697b21f791dbab919bc60" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60,backing_fmt=raw /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Updating instance_info_cache with network_info: [{"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60,backing_fmt=raw /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk 1073741824" returned: 0 in 0.065s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "c0536f94860f4c27480697b21f791dbab919bc60" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Releasing lock "refresh_cache-5b5e15d0-98d8-4f35-98ff-41e922792b05" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Instance network_info: |[{"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] Acquired lock "refresh_cache-5b5e15d0-98d8-4f35-98ff-41e922792b05" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Refreshing network info cache for port 4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Start _get_guest_xml network_info=[{"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:21:23Z,direct_url=<?>,disk_format='qcow2',id=955ca178-1253-4ff1-960e-38f2de9eb9ca,min_disk=0,min_ram=0,name='tempest-scenario-img--74236416',owner='48d191f70cfa47cfbf249e5a33695689',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:21:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '955ca178-1253-4ff1-960e-38f2de9eb9ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:21:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:21:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:21:23Z,direct_url=<?>,disk_format='qcow2',id=955ca178-1253-4ff1-960e-38f2de9eb9ca,min_disk=0,min_ram=0,name='tempest-scenario-img--74236416',owner='48d191f70cfa47cfbf249e5a33695689',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:21:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1807784993',display_name='tempest-TestMinimumBasicScenario-server-1807784993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1807784993',id=30,image_ref='955ca178-1253-4ff1-960e-38f2de9eb9ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4ymyvZ1mWMkdaYXWPsWlaZwrcoMg8ol0ZjRvVMYJEoUhDdZJWuck51LJpHnhDGfzRP46/tAeDS+0xyY6WrqidfS9dO1MfQaq8e+0NwbWMX75QVJJyXBECuES6EBHWV1g==',key_name='tempest-TestMinimumBasicScenario-1257628330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-pfj700y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='955ca178-1253-4ff1-960e-38f2de9eb9ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:21:28Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=5b5e15d0-98d8-4f35-98ff-41e922792b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.objects.instance [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5e15d0-98d8-4f35-98ff-41e922792b05 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:21:30 user nova-compute[74233]:   <uuid>5b5e15d0-98d8-4f35-98ff-41e922792b05</uuid>
Oct 20 18:21:30 user nova-compute[74233]:   <name>instance-0000001e</name>
Oct 20 18:21:30 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:21:30 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:21:30 user nova-compute[74233]:   <metadata>
Oct 20 18:21:30 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:21:30 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:21:30 user nova-compute[74233]:       <nova:name>tempest-TestMinimumBasicScenario-server-1807784993</nova:name>
Oct 20 18:21:30 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:21:30</nova:creationTime>
Oct 20 18:21:30 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:21:30 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:21:30 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:21:30 user nova-compute[74233]:       <nova:owner>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:user uuid="50fe59facf744cf5b860e3b60995c05a">tempest-TestMinimumBasicScenario-1650546036-project-member</nova:user>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:project uuid="48d191f70cfa47cfbf249e5a33695689">tempest-TestMinimumBasicScenario-1650546036</nova:project>
Oct 20 18:21:30 user nova-compute[74233]:       </nova:owner>
Oct 20 18:21:30 user nova-compute[74233]:       <nova:root type="image" uuid="955ca178-1253-4ff1-960e-38f2de9eb9ca"/>
Oct 20 18:21:30 user nova-compute[74233]:       <nova:ports>
Oct 20 18:21:30 user nova-compute[74233]:         <nova:port uuid="4c5656c6-8f29-40ac-b14b-f313865a800d">
Oct 20 18:21:30 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:21:30 user nova-compute[74233]:         </nova:port>
Oct 20 18:21:30 user nova-compute[74233]:       </nova:ports>
Oct 20 18:21:30 user nova-compute[74233]:     </nova:instance>
Oct 20 18:21:30 user nova-compute[74233]:   </metadata>
Oct 20 18:21:30 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:21:30 user nova-compute[74233]:     <system>
Oct 20 18:21:30 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:21:30 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:21:30 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:21:30 user nova-compute[74233]:       <entry name="serial">5b5e15d0-98d8-4f35-98ff-41e922792b05</entry>
Oct 20 18:21:30 user nova-compute[74233]:       <entry name="uuid">5b5e15d0-98d8-4f35-98ff-41e922792b05</entry>
Oct 20 18:21:30 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:21:30 user nova-compute[74233]:     </system>
Oct 20 18:21:30 user nova-compute[74233]:   </sysinfo>
Oct 20 18:21:30 user nova-compute[74233]:   <os>
Oct 20 18:21:30 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:21:30 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:21:30 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:21:30 user nova-compute[74233]:   </os>
Oct 20 18:21:30 user nova-compute[74233]:   <features>
Oct 20 18:21:30 user nova-compute[74233]:     <acpi/>
Oct 20 18:21:30 user nova-compute[74233]:     <apic/>
Oct 20 18:21:30 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:21:30 user nova-compute[74233]:   </features>
Oct 20 18:21:30 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:21:30 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:21:30 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:21:30 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:21:30 user nova-compute[74233]:   </clock>
Oct 20 18:21:30 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:21:30 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:21:30 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:21:30 user nova-compute[74233]:   </cpu>
Oct 20 18:21:30 user nova-compute[74233]:   <devices>
Oct 20 18:21:30 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:21:30 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:21:30 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk"/>
Oct 20 18:21:30 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:21:30 user nova-compute[74233]:     </disk>
Oct 20 18:21:30 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:21:30 user nova-compute[74233]:       <mac address="fa:16:3e:be:4d:be"/>
Oct 20 18:21:30 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:21:30 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:21:30 user nova-compute[74233]:       <target dev="tap4c5656c6-8f"/>
Oct 20 18:21:30 user nova-compute[74233]:     </interface>
Oct 20 18:21:30 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:21:30 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/console.log" append="off"/>
Oct 20 18:21:30 user nova-compute[74233]:     </serial>
Oct 20 18:21:30 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:21:30 user nova-compute[74233]:     <video>
Oct 20 18:21:30 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:21:30 user nova-compute[74233]:     </video>
Oct 20 18:21:30 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:21:30 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:21:30 user nova-compute[74233]:     </rng>
Oct 20 18:21:30 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:21:30 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:21:30 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:21:30 user nova-compute[74233]:     </memballoon>
Oct 20 18:21:30 user nova-compute[74233]:   </devices>
Oct 20 18:21:30 user nova-compute[74233]: </domain>
Oct 20 18:21:30 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1807784993',display_name='tempest-TestMinimumBasicScenario-server-1807784993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1807784993',id=30,image_ref='955ca178-1253-4ff1-960e-38f2de9eb9ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4ymyvZ1mWMkdaYXWPsWlaZwrcoMg8ol0ZjRvVMYJEoUhDdZJWuck51LJpHnhDGfzRP46/tAeDS+0xyY6WrqidfS9dO1MfQaq8e+0NwbWMX75QVJJyXBECuES6EBHWV1g==',key_name='tempest-TestMinimumBasicScenario-1257628330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-pfj700y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='955ca178-1253-4ff1-960e-38f2de9eb9ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:21:28Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=5b5e15d0-98d8-4f35-98ff-41e922792b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG os_vif [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a43abc42-542e-51e4-96ce-94d493ccef87', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c5656c6-8f, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c5656c6-8f, col_values=(('qos', UUID('f321bc26-eabc-4f84-b6b2-43d8e633884c')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c5656c6-8f, col_values=(('external_ids', {'iface-id': '4c5656c6-8f29-40ac-b14b-f313865a800d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:4d:be', 'vm-uuid': '5b5e15d0-98d8-4f35-98ff-41e922792b05'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:30 user nova-compute[74233]: INFO os_vif [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f')
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Updated VIF entry in instance network info cache for port 4c5656c6-8f29-40ac-b14b-f313865a800d. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Updating instance_info_cache with network_info: [{"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cb874c27-ac06-4d2e-bd7e-cda9552fcb79 req-570a55a9-8e4d-4b8d-8e65-bc2453a89092 service nova] Releasing lock "refresh_cache-5b5e15d0-98d8-4f35-98ff-41e922792b05" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:21:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] No VIF found with MAC fa:16:3e:be:4d:be, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-002dfaa9-9bfe-48c1-a6ae-350b2380d9e4 req-26c91229-9008-4185-976b-dd5264fe4b65 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-002dfaa9-9bfe-48c1-a6ae-350b2380d9e4 req-26c91229-9008-4185-976b-dd5264fe4b65 service nova] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-002dfaa9-9bfe-48c1-a6ae-350b2380d9e4 req-26c91229-9008-4185-976b-dd5264fe4b65 service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-002dfaa9-9bfe-48c1-a6ae-350b2380d9e4 req-26c91229-9008-4185-976b-dd5264fe4b65 service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-002dfaa9-9bfe-48c1-a6ae-350b2380d9e4 req-26c91229-9008-4185-976b-dd5264fe4b65 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] No waiting events found dispatching network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:32 user nova-compute[74233]: WARNING nova.compute.manager [req-002dfaa9-9bfe-48c1-a6ae-350b2380d9e4 req-26c91229-9008-4185-976b-dd5264fe4b65 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received unexpected event network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d for instance with vm_state building and task_state spawning.
Oct 20 18:21:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:21:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Instance spawned successfully.
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:21:34 user nova-compute[74233]: INFO nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Took 6.49 seconds to spawn the instance on the hypervisor.
Oct 20 18:21:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-e4a601b8-54e4-44c6-bdf8-df445e1312a2 req-01ae44d3-7916-4be1-97b1-b3aa0a411933 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e4a601b8-54e4-44c6-bdf8-df445e1312a2 req-01ae44d3-7916-4be1-97b1-b3aa0a411933 service nova] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e4a601b8-54e4-44c6-bdf8-df445e1312a2 req-01ae44d3-7916-4be1-97b1-b3aa0a411933 service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e4a601b8-54e4-44c6-bdf8-df445e1312a2 req-01ae44d3-7916-4be1-97b1-b3aa0a411933 service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-e4a601b8-54e4-44c6-bdf8-df445e1312a2 req-01ae44d3-7916-4be1-97b1-b3aa0a411933 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] No waiting events found dispatching network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:35 user nova-compute[74233]: WARNING nova.compute.manager [req-e4a601b8-54e4-44c6-bdf8-df445e1312a2 req-01ae44d3-7916-4be1-97b1-b3aa0a411933 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received unexpected event network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d for instance with vm_state building and task_state spawning.
Oct 20 18:21:35 user nova-compute[74233]: INFO nova.compute.manager [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Took 7.59 seconds to build instance.
Oct 20 18:21:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1999ce01-967a-4a98-bf23-6825795ba720 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.718s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-changed-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Refreshing instance network info cache due to event network-changed-ab368db6-e76a-4cea-817d-3f097d84fb49. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:21:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] Acquiring lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:21:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] Acquired lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:21:52 user nova-compute[74233]: DEBUG nova.network.neutron [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Refreshing network info cache for port ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updated VIF entry in instance network info cache for port ab368db6-e76a-4cea-817d-3f097d84fb49. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updating instance_info_cache with network_info: [{"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e873feed-2b44-4ee5-995b-893789b2d6c5 req-9579737e-de8a-4249-bfd5-110b7a8e8d5b service nova] Releasing lock "refresh_cache-4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:53 user nova-compute[74233]: INFO nova.compute.manager [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Terminating instance
Oct 20 18:21:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Instance destroyed successfully.
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.objects.instance [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'resources' on Instance uuid 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1353402674',display_name='tempest-TestVolumeBootPattern-server-1353402674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1353402674',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-4tb9na0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:20:36Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=4aa2830b-d7e0-4e15-afc5-285cf3ca2f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "ab368db6-e76a-4cea-817d-3f097d84fb49", "address": "fa:16:3e:b5:0c:86", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab368db6-e7", "ovs_interfaceid": "ab368db6-e76a-4cea-817d-3f097d84fb49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_vif [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab368db6-e7, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e3baaa3-43df-4e6d-a66e-f742643bcb72) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:21:54 user nova-compute[74233]: INFO os_vif [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:0c:86,bridge_name='br-int',has_traffic_filtering=True,id=ab368db6-e76a-4cea-817d-3f097d84fb49,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab368db6-e7')
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:21:54 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b490a30d-3e5a-4d9c-b23b-3c311ad752f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:21:54 user nova-compute[74233]: No targets found.
Oct 20 18:21:54 user nova-compute[74233]: iSNS:
Oct 20 18:21:54 user nova-compute[74233]: No targets found.
Oct 20 18:21:54 user nova-compute[74233]: STATIC:
Oct 20 18:21:54 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:21:54 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:21:54 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:21:54 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:21:54 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:21:54 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:21:54 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:21:54 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:21:54 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:21:54 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:21:54 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:21:54 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:21:54 user nova-compute[74233]: FIRMWARE:
Oct 20 18:21:54 user nova-compute[74233]: No targets found.
Oct 20 18:21:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:21:54 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:21:54 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf257b3-5d2b-462f-a081-29d5721494ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e96d2-7b49-4e54-9a26-e282783c35a4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:21:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb98a881e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cde431-5d63-46f8-ac34-fcf08d778afd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[524b1319-4f15-494b-99be-8c9104397b87]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f275e9b2-2395-446b-b074-4b9d3bee431b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0cacc7-8353-4964-a95e-816c7ec3db43]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6ae742b', '/dev/disk/by-id/scsi-23634613631313966', '/dev/disk/by-id/scsi-1SCST_BIOf6ae742b-64a6119fa8aa628d') {{(pid=85316) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd247b-6d90-4889-9edb-15ec854ee635]: (4, None) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8df738-ac3c-4473-aafa-4332fdc50d87]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9f1a7-b1d0-40f8-aa00-e6816e4f8341]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]
Oct 20 18:21:54 user nova-compute[74233]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.
Oct 20 18:21:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1391eef-5221-4d2c-8d40-a9433b132fb4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== disconnect_volume: return (319ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:21:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Deleting instance files /opt/stack/data/nova/instances/4aa2830b-d7e0-4e15-afc5-285cf3ca2f53_del
Oct 20 18:21:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Deletion of /opt/stack/data/nova/instances/4aa2830b-d7e0-4e15-afc5-285cf3ca2f53_del complete
Oct 20 18:21:54 user nova-compute[74233]: INFO nova.compute.manager [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-vif-unplugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] No waiting events found dispatching network-vif-unplugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-vif-unplugged-ab368db6-e76a-4cea-817d-3f097d84fb49 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] Acquiring lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] No waiting events found dispatching network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:21:54 user nova-compute[74233]: WARNING nova.compute.manager [req-7687c698-5439-479f-b713-84bc8cc654b9 req-68b21bb3-d9e3-4fcf-8a44-fb37b3e477af service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received unexpected event network-vif-plugged-ab368db6-e76a-4cea-817d-3f097d84fb49 for instance with vm_state active and task_state deleting.
Oct 20 18:21:55 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:21:55 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Took 0.77 seconds to deallocate network for instance.
Oct 20 18:21:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-bef54f2a-6469-4d85-928f-e7eba4e1e467 req-702054b6-2731-4e6e-98e1-3aa5aa59131b service nova] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Received event network-vif-deleted-ab368db6-e76a-4cea-817d-3f097d84fb49 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:21:56 user nova-compute[74233]: INFO nova.compute.manager [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 18:21:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:21:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:21:56 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:21:56 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:21:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:56 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Deleted allocations for instance 4aa2830b-d7e0-4e15-afc5-285cf3ca2f53
Oct 20 18:21:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-440a4c06-35f6-4cc2-93e4-322d1bb951a9 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "4aa2830b-d7e0-4e15-afc5-285cf3ca2f53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.400s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:21:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:21:58 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:21:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:21:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:22:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:22:02 user nova-compute[74233]: INFO nova.compute.claims [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Claim successful on node user
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:22:03 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.policy [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48d29b4bd2074808898ec96be8e0e471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c9b3d85046f4cf78cd79703b467f80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:22:03 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Creating image(s)
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "/opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "/opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk 1073741824" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Successfully created port: ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.507s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Cannot resize image /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Ensure instance console log exists: /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:04 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:04 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7542MB free_disk=24.951976776123047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance bae683b9-94e9-4e4f-9621-93c2410d2351 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance debfd120-e237-4afa-9b36-2bed99e48379 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5b5e15d0-98d8-4f35-98ff-41e922792b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:22:04 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Successfully updated port: ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquired lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-changed-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Refreshing instance network info cache due to event network-changed-ede62683-5cec-4a67-93a3-e8a29411c4b0. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] Acquiring lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updating instance_info_cache with network_info: [{"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Releasing lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Instance network_info: |[{"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] Acquired lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Refreshing network info cache for port ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Start _get_guest_xml network_info=[{"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:22:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:05 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2067294774',display_name='tempest-VolumesSnapshotTestJSON-instance-2067294774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2067294774',id=31,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADxm7BlI8AmWAo99SjWM7E0dqGLBsg7clsaTc1oEV8+Pr7jlqts4OCLj3sMul37JDW9imggglrWLxA5mc4/xRG0uZ+5wRoQ3J5Mb+Ahc4sH0JHNIFIsiLxScTP04DMlMw==',key_name='tempest-keypair-1228422228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9b3d85046f4cf78cd79703b467f80e',ramdisk_id='',reservation_id='r-mgf5huem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1067753256',owner_user_name='tempest-VolumesSnapshotTestJSON-1067753256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d29b4bd2074808898ec96be8e0e471',uuid=0b81120b-9d1d-45e9-88c3-e9eaca49c210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converting VIF {"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:22:05 user nova-compute[74233]:   <uuid>0b81120b-9d1d-45e9-88c3-e9eaca49c210</uuid>
Oct 20 18:22:05 user nova-compute[74233]:   <name>instance-0000001f</name>
Oct 20 18:22:05 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:22:05 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:22:05 user nova-compute[74233]:   <metadata>
Oct 20 18:22:05 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:22:05 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:22:05 user nova-compute[74233]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2067294774</nova:name>
Oct 20 18:22:05 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:22:05</nova:creationTime>
Oct 20 18:22:05 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:22:05 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:22:05 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:22:05 user nova-compute[74233]:       <nova:owner>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:user uuid="48d29b4bd2074808898ec96be8e0e471">tempest-VolumesSnapshotTestJSON-1067753256-project-member</nova:user>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:project uuid="5c9b3d85046f4cf78cd79703b467f80e">tempest-VolumesSnapshotTestJSON-1067753256</nova:project>
Oct 20 18:22:05 user nova-compute[74233]:       </nova:owner>
Oct 20 18:22:05 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:22:05 user nova-compute[74233]:       <nova:ports>
Oct 20 18:22:05 user nova-compute[74233]:         <nova:port uuid="ede62683-5cec-4a67-93a3-e8a29411c4b0">
Oct 20 18:22:05 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:22:05 user nova-compute[74233]:         </nova:port>
Oct 20 18:22:05 user nova-compute[74233]:       </nova:ports>
Oct 20 18:22:05 user nova-compute[74233]:     </nova:instance>
Oct 20 18:22:05 user nova-compute[74233]:   </metadata>
Oct 20 18:22:05 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:22:05 user nova-compute[74233]:     <system>
Oct 20 18:22:05 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:22:05 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:22:05 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:22:05 user nova-compute[74233]:       <entry name="serial">0b81120b-9d1d-45e9-88c3-e9eaca49c210</entry>
Oct 20 18:22:05 user nova-compute[74233]:       <entry name="uuid">0b81120b-9d1d-45e9-88c3-e9eaca49c210</entry>
Oct 20 18:22:05 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:22:05 user nova-compute[74233]:     </system>
Oct 20 18:22:05 user nova-compute[74233]:   </sysinfo>
Oct 20 18:22:05 user nova-compute[74233]:   <os>
Oct 20 18:22:05 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:22:05 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:22:05 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:22:05 user nova-compute[74233]:   </os>
Oct 20 18:22:05 user nova-compute[74233]:   <features>
Oct 20 18:22:05 user nova-compute[74233]:     <acpi/>
Oct 20 18:22:05 user nova-compute[74233]:     <apic/>
Oct 20 18:22:05 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:22:05 user nova-compute[74233]:   </features>
Oct 20 18:22:05 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:22:05 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:22:05 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:22:05 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:22:05 user nova-compute[74233]:   </clock>
Oct 20 18:22:05 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:22:05 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:22:05 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:22:05 user nova-compute[74233]:   </cpu>
Oct 20 18:22:05 user nova-compute[74233]:   <devices>
Oct 20 18:22:05 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:22:05 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:22:05 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk"/>
Oct 20 18:22:05 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:22:05 user nova-compute[74233]:     </disk>
Oct 20 18:22:05 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:22:05 user nova-compute[74233]:       <mac address="fa:16:3e:df:75:a0"/>
Oct 20 18:22:05 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:22:05 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:22:05 user nova-compute[74233]:       <target dev="tapede62683-5c"/>
Oct 20 18:22:05 user nova-compute[74233]:     </interface>
Oct 20 18:22:05 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:22:05 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/console.log" append="off"/>
Oct 20 18:22:05 user nova-compute[74233]:     </serial>
Oct 20 18:22:05 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:22:05 user nova-compute[74233]:     <video>
Oct 20 18:22:05 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:22:05 user nova-compute[74233]:     </video>
Oct 20 18:22:05 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:22:05 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:22:05 user nova-compute[74233]:     </rng>
Oct 20 18:22:05 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:22:05 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:22:05 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:22:05 user nova-compute[74233]:     </memballoon>
Oct 20 18:22:05 user nova-compute[74233]:   </devices>
Oct 20 18:22:05 user nova-compute[74233]: </domain>
Oct 20 18:22:05 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2067294774',display_name='tempest-VolumesSnapshotTestJSON-instance-2067294774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2067294774',id=31,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADxm7BlI8AmWAo99SjWM7E0dqGLBsg7clsaTc1oEV8+Pr7jlqts4OCLj3sMul37JDW9imggglrWLxA5mc4/xRG0uZ+5wRoQ3J5Mb+Ahc4sH0JHNIFIsiLxScTP04DMlMw==',key_name='tempest-keypair-1228422228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9b3d85046f4cf78cd79703b467f80e',ramdisk_id='',reservation_id='r-mgf5huem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1067753256',owner_user_name='tempest-VolumesSnapshotTestJSON-1067753256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d29b4bd2074808898ec96be8e0e471',uuid=0b81120b-9d1d-45e9-88c3-e9eaca49c210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converting VIF {"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG os_vif [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2dd61d50-5777-50ae-80ad-2bd3f91b6e4d', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapede62683-5c, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapede62683-5c, col_values=(('qos', UUID('d2fed8f8-2b84-46a0-bfc4-84dbc7f30d8c')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapede62683-5c, col_values=(('external_ids', {'iface-id': 'ede62683-5cec-4a67-93a3-e8a29411c4b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:75:a0', 'vm-uuid': '0b81120b-9d1d-45e9-88c3-e9eaca49c210'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:05 user nova-compute[74233]: INFO os_vif [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c')
Oct 20 18:22:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:22:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No VIF found with MAC fa:16:3e:df:75:a0, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:22:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updated VIF entry in instance network info cache for port ede62683-5cec-4a67-93a3-e8a29411c4b0. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:22:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updating instance_info_cache with network_info: [{"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ec8a163c-71ab-48ef-baff-29fab4807188 req-4e83517e-16ff-46e4-90bc-3383816ad253 service nova] Releasing lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-ca31f588-ba38-48bd-acfb-1e7a90894b4a req-31888520-1be6-46d3-b2c1-bc1bd696cf15 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ca31f588-ba38-48bd-acfb-1e7a90894b4a req-31888520-1be6-46d3-b2c1-bc1bd696cf15 service nova] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ca31f588-ba38-48bd-acfb-1e7a90894b4a req-31888520-1be6-46d3-b2c1-bc1bd696cf15 service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ca31f588-ba38-48bd-acfb-1e7a90894b4a req-31888520-1be6-46d3-b2c1-bc1bd696cf15 service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-ca31f588-ba38-48bd-acfb-1e7a90894b4a req-31888520-1be6-46d3-b2c1-bc1bd696cf15 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] No waiting events found dispatching network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:07 user nova-compute[74233]: WARNING nova.compute.manager [req-ca31f588-ba38-48bd-acfb-1e7a90894b4a req-31888520-1be6-46d3-b2c1-bc1bd696cf15 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received unexpected event network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 for instance with vm_state building and task_state spawning.
Oct 20 18:22:07 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-8a7eae28-d640-4263-a2f3-f2daa6d13d55 req-a3ddf8e6-bead-47f4-adf2-82ed87425883 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a7eae28-d640-4263-a2f3-f2daa6d13d55 req-a3ddf8e6-bead-47f4-adf2-82ed87425883 service nova] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a7eae28-d640-4263-a2f3-f2daa6d13d55 req-a3ddf8e6-bead-47f4-adf2-82ed87425883 service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a7eae28-d640-4263-a2f3-f2daa6d13d55 req-a3ddf8e6-bead-47f4-adf2-82ed87425883 service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.compute.manager [req-8a7eae28-d640-4263-a2f3-f2daa6d13d55 req-a3ddf8e6-bead-47f4-adf2-82ed87425883 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] No waiting events found dispatching network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:09 user nova-compute[74233]: WARNING nova.compute.manager [req-8a7eae28-d640-4263-a2f3-f2daa6d13d55 req-a3ddf8e6-bead-47f4-adf2-82ed87425883 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received unexpected event network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 for instance with vm_state building and task_state spawning.
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:22:09 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Instance spawned successfully.
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:09 user nova-compute[74233]: INFO nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 20 18:22:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:22:09 user nova-compute[74233]: INFO nova.compute.manager [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Took 7.68 seconds to build instance.
Oct 20 18:22:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c5ea452f-4dbd-4926-a6a2-d04c8bd25e3c tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.801s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:22:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:22:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:22:13 user nova-compute[74233]: INFO nova.compute.claims [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Claim successful on node user
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:22:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.policy [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd132de50b442419e8f3a059e650902e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0083be86b8f04d16a891eadad4dccbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:22:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Creating image(s)
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk 1073741824" returned: 0 in 0.070s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Successfully created port: 10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Cannot resize image /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Successfully updated port: 10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquired lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-changed-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Refreshing instance network info cache due to event network-changed-10c936e6-7609-4bd3-9374-e18e5503c689. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] Acquiring lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:22:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating instance_info_cache with network_info: [{"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Releasing lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance network_info: |[{"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] Acquired lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.neutron [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Refreshing network info cache for port 10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Start _get_guest_xml network_info=[{"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:22:16 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:16 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-13211816',display_name='tempest-tempest.common.compute-instance-13211816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-13211816',id=32,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDkG3eixSC9gYo6kNgsId3y7xJBVqfNTJcfeDkXB4fKSG6GYa7Hxh97vm3lDnEBW3Dhhhctco6EJLFmoisxDflzxlnK3Z6N6U7kZND6xrKsWC9Kbr/+pjFjQ0QfP6rlvw==',key_name='tempest-keypair-142935039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-mhezx8yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=aeb06e35-8797-4a76-a54b-f4d2dbb329d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'pci_devices' on Instance uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:22:16 user nova-compute[74233]:   <uuid>aeb06e35-8797-4a76-a54b-f4d2dbb329d3</uuid>
Oct 20 18:22:16 user nova-compute[74233]:   <name>instance-00000020</name>
Oct 20 18:22:16 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:22:16 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:22:16 user nova-compute[74233]:   <metadata>
Oct 20 18:22:16 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:22:16 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:22:16 user nova-compute[74233]:       <nova:name>tempest-tempest.common.compute-instance-13211816</nova:name>
Oct 20 18:22:16 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:22:16</nova:creationTime>
Oct 20 18:22:16 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:22:16 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:22:16 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:22:16 user nova-compute[74233]:       <nova:owner>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:user uuid="d132de50b442419e8f3a059e650902e7">tempest-ServerActionsTestOtherA-835796467-project-member</nova:user>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:project uuid="0083be86b8f04d16a891eadad4dccbe6">tempest-ServerActionsTestOtherA-835796467</nova:project>
Oct 20 18:22:16 user nova-compute[74233]:       </nova:owner>
Oct 20 18:22:16 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:22:16 user nova-compute[74233]:       <nova:ports>
Oct 20 18:22:16 user nova-compute[74233]:         <nova:port uuid="10c936e6-7609-4bd3-9374-e18e5503c689">
Oct 20 18:22:16 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:22:16 user nova-compute[74233]:         </nova:port>
Oct 20 18:22:16 user nova-compute[74233]:       </nova:ports>
Oct 20 18:22:16 user nova-compute[74233]:     </nova:instance>
Oct 20 18:22:16 user nova-compute[74233]:   </metadata>
Oct 20 18:22:16 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:22:16 user nova-compute[74233]:     <system>
Oct 20 18:22:16 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:22:16 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:22:16 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:22:16 user nova-compute[74233]:       <entry name="serial">aeb06e35-8797-4a76-a54b-f4d2dbb329d3</entry>
Oct 20 18:22:16 user nova-compute[74233]:       <entry name="uuid">aeb06e35-8797-4a76-a54b-f4d2dbb329d3</entry>
Oct 20 18:22:16 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:22:16 user nova-compute[74233]:     </system>
Oct 20 18:22:16 user nova-compute[74233]:   </sysinfo>
Oct 20 18:22:16 user nova-compute[74233]:   <os>
Oct 20 18:22:16 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:22:16 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:22:16 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:22:16 user nova-compute[74233]:   </os>
Oct 20 18:22:16 user nova-compute[74233]:   <features>
Oct 20 18:22:16 user nova-compute[74233]:     <acpi/>
Oct 20 18:22:16 user nova-compute[74233]:     <apic/>
Oct 20 18:22:16 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:22:16 user nova-compute[74233]:   </features>
Oct 20 18:22:16 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:22:16 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:22:16 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:22:16 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:22:16 user nova-compute[74233]:   </clock>
Oct 20 18:22:16 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:22:16 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:22:16 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:22:16 user nova-compute[74233]:   </cpu>
Oct 20 18:22:16 user nova-compute[74233]:   <devices>
Oct 20 18:22:16 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:22:16 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:22:16 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk"/>
Oct 20 18:22:16 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:22:16 user nova-compute[74233]:     </disk>
Oct 20 18:22:16 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:22:16 user nova-compute[74233]:       <mac address="fa:16:3e:1d:b1:ef"/>
Oct 20 18:22:16 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:22:16 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:22:16 user nova-compute[74233]:       <target dev="tap10c936e6-76"/>
Oct 20 18:22:16 user nova-compute[74233]:     </interface>
Oct 20 18:22:16 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:22:16 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/console.log" append="off"/>
Oct 20 18:22:16 user nova-compute[74233]:     </serial>
Oct 20 18:22:16 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:22:16 user nova-compute[74233]:     <video>
Oct 20 18:22:16 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:22:16 user nova-compute[74233]:     </video>
Oct 20 18:22:16 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:22:16 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:22:16 user nova-compute[74233]:     </rng>
Oct 20 18:22:16 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:22:16 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:22:16 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:22:16 user nova-compute[74233]:     </memballoon>
Oct 20 18:22:16 user nova-compute[74233]:   </devices>
Oct 20 18:22:16 user nova-compute[74233]: </domain>
Oct 20 18:22:16 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-13211816',display_name='tempest-tempest.common.compute-instance-13211816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-13211816',id=32,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDkG3eixSC9gYo6kNgsId3y7xJBVqfNTJcfeDkXB4fKSG6GYa7Hxh97vm3lDnEBW3Dhhhctco6EJLFmoisxDflzxlnK3Z6N6U7kZND6xrKsWC9Kbr/+pjFjQ0QfP6rlvw==',key_name='tempest-keypair-142935039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-mhezx8yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=aeb06e35-8797-4a76-a54b-f4d2dbb329d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG os_vif [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c1d4a55-36f8-52d7-99b3-1b1bd4bcfdef', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10c936e6-76, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10c936e6-76, col_values=(('qos', UUID('ab25fb6d-3a5b-4dca-b83a-c79701121ca1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10c936e6-76, col_values=(('external_ids', {'iface-id': '10c936e6-7609-4bd3-9374-e18e5503c689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:b1:ef', 'vm-uuid': 'aeb06e35-8797-4a76-a54b-f4d2dbb329d3'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:16 user nova-compute[74233]: INFO os_vif [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76')
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No VIF found with MAC fa:16:3e:1d:b1:ef, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.neutron [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updated VIF entry in instance network info cache for port 10c936e6-7609-4bd3-9374-e18e5503c689. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG nova.network.neutron [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating instance_info_cache with network_info: [{"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e644d84-9775-4320-a15e-17e60024165d req-6ac0ef9c-18a5-4a66-b7cf-109385ebf7da service nova] Releasing lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:22:19 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance spawned successfully.
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:19 user nova-compute[74233]: INFO nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 20 18:22:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:22:20 user nova-compute[74233]: INFO nova.compute.manager [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Took 6.46 seconds to build instance.
Oct 20 18:22:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b54f6c6f-9b63-46c4-82f9-bc4ed768c995 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.555s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:22:22 user nova-compute[74233]: INFO nova.compute.claims [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Claim successful on node user
Oct 20 18:22:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-c1c3a376-5e49-4233-bb4b-1d4129865590 req-8fd7d7a7-2bad-41ee-a1cd-dfa020a80345 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c1c3a376-5e49-4233-bb4b-1d4129865590 req-8fd7d7a7-2bad-41ee-a1cd-dfa020a80345 service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c1c3a376-5e49-4233-bb4b-1d4129865590 req-8fd7d7a7-2bad-41ee-a1cd-dfa020a80345 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c1c3a376-5e49-4233-bb4b-1d4129865590 req-8fd7d7a7-2bad-41ee-a1cd-dfa020a80345 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-c1c3a376-5e49-4233-bb4b-1d4129865590 req-8fd7d7a7-2bad-41ee-a1cd-dfa020a80345 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:22 user nova-compute[74233]: WARNING nova.compute.manager [req-c1c3a376-5e49-4233-bb4b-1d4129865590 req-8fd7d7a7-2bad-41ee-a1cd-dfa020a80345 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state active and task_state None.
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.764s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:22:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.policy [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4890b8a259c742de8e6ac402143f38cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bb97db0e34d669a02e48524574e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:22:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Creating image(s)
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "/opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "/opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "/opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.235s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.219s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk 1073741824" returned: 0 in 0.067s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.270s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Successfully created port: d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Cannot resize image /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Ensure instance console log exists: /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-2f4ef615-160c-446a-a46a-bb7f7af4faf7 req-f1f90d91-7033-4aae-a219-7d8505dbe899 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2f4ef615-160c-446a-a46a-bb7f7af4faf7 req-f1f90d91-7033-4aae-a219-7d8505dbe899 service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2f4ef615-160c-446a-a46a-bb7f7af4faf7 req-f1f90d91-7033-4aae-a219-7d8505dbe899 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2f4ef615-160c-446a-a46a-bb7f7af4faf7 req-f1f90d91-7033-4aae-a219-7d8505dbe899 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-2f4ef615-160c-446a-a46a-bb7f7af4faf7 req-f1f90d91-7033-4aae-a219-7d8505dbe899 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:25 user nova-compute[74233]: WARNING nova.compute.manager [req-2f4ef615-160c-446a-a46a-bb7f7af4faf7 req-f1f90d91-7033-4aae-a219-7d8505dbe899 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state active and task_state None.
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Successfully updated port: d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquired lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-changed-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Refreshing instance network info cache due to event network-changed-d02fb71a-88f4-47ad-9ac4-3e2609efaeac. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] Acquiring lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating instance_info_cache with network_info: [{"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Releasing lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Instance network_info: |[{"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] Acquired lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.neutron [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Refreshing network info cache for port d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Start _get_guest_xml network_info=[{"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:22:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-32273927',display_name='tempest-SnapshotDataIntegrityTests-server-32273927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-32273927',id=33,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhXFMAOUNAJu33WxfpHsvesKNVem+XIID7i6NZXLeBeMYzoVs7R+xdkhUpufVetpU4m9O08gpQT0OFr1F7ZiQRxlzly6lLrB7aiCjr8KV6Zv6RXCGYO2kSueVv2tgjyow==',key_name='tempest-keypair-1054100320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='581bb97db0e34d669a02e48524574e09',ramdisk_id='',reservation_id='r-liev30ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1105034583',owner_user_name='tempest-SnapshotDataIntegrityTests-1105034583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4890b8a259c742de8e6ac402143f38cb',uuid=362fb740-c18c-44f7-a034-ff26f2d1d588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Converting VIF {"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.objects.instance [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'pci_devices' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:22:25 user nova-compute[74233]:   <uuid>362fb740-c18c-44f7-a034-ff26f2d1d588</uuid>
Oct 20 18:22:25 user nova-compute[74233]:   <name>instance-00000021</name>
Oct 20 18:22:25 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:22:25 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:22:25 user nova-compute[74233]:   <metadata>
Oct 20 18:22:25 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:22:25 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:22:25 user nova-compute[74233]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-32273927</nova:name>
Oct 20 18:22:25 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:22:25</nova:creationTime>
Oct 20 18:22:25 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:22:25 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:22:25 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:22:25 user nova-compute[74233]:       <nova:owner>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:user uuid="4890b8a259c742de8e6ac402143f38cb">tempest-SnapshotDataIntegrityTests-1105034583-project-member</nova:user>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:project uuid="581bb97db0e34d669a02e48524574e09">tempest-SnapshotDataIntegrityTests-1105034583</nova:project>
Oct 20 18:22:25 user nova-compute[74233]:       </nova:owner>
Oct 20 18:22:25 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:22:25 user nova-compute[74233]:       <nova:ports>
Oct 20 18:22:25 user nova-compute[74233]:         <nova:port uuid="d02fb71a-88f4-47ad-9ac4-3e2609efaeac">
Oct 20 18:22:25 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 18:22:25 user nova-compute[74233]:         </nova:port>
Oct 20 18:22:25 user nova-compute[74233]:       </nova:ports>
Oct 20 18:22:25 user nova-compute[74233]:     </nova:instance>
Oct 20 18:22:25 user nova-compute[74233]:   </metadata>
Oct 20 18:22:25 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:22:25 user nova-compute[74233]:     <system>
Oct 20 18:22:25 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:22:25 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:22:25 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:22:25 user nova-compute[74233]:       <entry name="serial">362fb740-c18c-44f7-a034-ff26f2d1d588</entry>
Oct 20 18:22:25 user nova-compute[74233]:       <entry name="uuid">362fb740-c18c-44f7-a034-ff26f2d1d588</entry>
Oct 20 18:22:25 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:22:25 user nova-compute[74233]:     </system>
Oct 20 18:22:25 user nova-compute[74233]:   </sysinfo>
Oct 20 18:22:25 user nova-compute[74233]:   <os>
Oct 20 18:22:25 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:22:25 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:22:25 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:22:25 user nova-compute[74233]:   </os>
Oct 20 18:22:25 user nova-compute[74233]:   <features>
Oct 20 18:22:25 user nova-compute[74233]:     <acpi/>
Oct 20 18:22:25 user nova-compute[74233]:     <apic/>
Oct 20 18:22:25 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:22:25 user nova-compute[74233]:   </features>
Oct 20 18:22:25 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:22:25 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:22:25 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:22:25 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:22:25 user nova-compute[74233]:   </clock>
Oct 20 18:22:25 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:22:25 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:22:25 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:22:25 user nova-compute[74233]:   </cpu>
Oct 20 18:22:25 user nova-compute[74233]:   <devices>
Oct 20 18:22:25 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:22:25 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:22:25 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk"/>
Oct 20 18:22:25 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:22:25 user nova-compute[74233]:     </disk>
Oct 20 18:22:25 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:22:25 user nova-compute[74233]:       <mac address="fa:16:3e:74:9a:63"/>
Oct 20 18:22:25 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:22:25 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:22:25 user nova-compute[74233]:       <target dev="tapd02fb71a-88"/>
Oct 20 18:22:25 user nova-compute[74233]:     </interface>
Oct 20 18:22:25 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:22:25 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/console.log" append="off"/>
Oct 20 18:22:25 user nova-compute[74233]:     </serial>
Oct 20 18:22:25 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:22:25 user nova-compute[74233]:     <video>
Oct 20 18:22:25 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:22:25 user nova-compute[74233]:     </video>
Oct 20 18:22:25 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:22:25 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:22:25 user nova-compute[74233]:     </rng>
Oct 20 18:22:25 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:22:25 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:22:25 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:22:25 user nova-compute[74233]:     </memballoon>
Oct 20 18:22:25 user nova-compute[74233]:   </devices>
Oct 20 18:22:25 user nova-compute[74233]: </domain>
Oct 20 18:22:25 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-32273927',display_name='tempest-SnapshotDataIntegrityTests-server-32273927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-32273927',id=33,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhXFMAOUNAJu33WxfpHsvesKNVem+XIID7i6NZXLeBeMYzoVs7R+xdkhUpufVetpU4m9O08gpQT0OFr1F7ZiQRxlzly6lLrB7aiCjr8KV6Zv6RXCGYO2kSueVv2tgjyow==',key_name='tempest-keypair-1054100320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='581bb97db0e34d669a02e48524574e09',ramdisk_id='',reservation_id='r-liev30ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1105034583',owner_user_name='tempest-SnapshotDataIntegrityTests-1105034583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4890b8a259c742de8e6ac402143f38cb',uuid=362fb740-c18c-44f7-a034-ff26f2d1d588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Converting VIF {"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG os_vif [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2a883a9-66dd-5598-a9fd-574323e3dcb0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd02fb71a-88, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd02fb71a-88, col_values=(('qos', UUID('5c5f4c82-5a63-4b43-82c7-4442840e5244')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd02fb71a-88, col_values=(('external_ids', {'iface-id': 'd02fb71a-88f4-47ad-9ac4-3e2609efaeac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:9a:63', 'vm-uuid': '362fb740-c18c-44f7-a034-ff26f2d1d588'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:25 user nova-compute[74233]: INFO os_vif [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88')
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:22:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No VIF found with MAC fa:16:3e:74:9a:63, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:22:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updated VIF entry in instance network info cache for port d02fb71a-88f4-47ad-9ac4-3e2609efaeac. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:22:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating instance_info_cache with network_info: [{"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d80196b4-6a61-4eb1-9f13-2bfebdef6b33 req-ee602c07-ba6c-42c5-9d32-a89e568b3231 service nova] Releasing lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'flavor' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-64aa6d45-db62-4578-8c62-2f9eed202a5d req-591bb740-9509-416c-b77b-03c57a21fd12 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-64aa6d45-db62-4578-8c62-2f9eed202a5d req-591bb740-9509-416c-b77b-03c57a21fd12 service nova] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-64aa6d45-db62-4578-8c62-2f9eed202a5d req-591bb740-9509-416c-b77b-03c57a21fd12 service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-64aa6d45-db62-4578-8c62-2f9eed202a5d req-591bb740-9509-416c-b77b-03c57a21fd12 service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-64aa6d45-db62-4578-8c62-2f9eed202a5d req-591bb740-9509-416c-b77b-03c57a21fd12 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] No waiting events found dispatching network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:27 user nova-compute[74233]: WARNING nova.compute.manager [req-64aa6d45-db62-4578-8c62-2f9eed202a5d req-591bb740-9509-416c-b77b-03c57a21fd12 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received unexpected event network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac for instance with vm_state building and task_state spawning.
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:27 user nova-compute[74233]: INFO nova.compute.manager [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Attaching volume 0489f953-4e2a-46cc-8a04-b8ffe75a5668 to /dev/vdb
Oct 20 18:22:27 user nova-compute[74233]: DEBUG os_brick.utils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4735e34-4713-4b9d-99b2-f8eac9105274]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714bf99-2c57-4b9e-96c3-e931e40680b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb338d-70a6-46c6-acd6-22731f459a67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e0b736-3d55-42c6-a7b3-c74b18f438a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:22:27 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:22:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b5e444-7960-4748-9271-300662a54691]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG os_brick.utils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating existing volume attachment record: 678a5c54-9a4e-4c5d-84ed-215f0b166a62 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:22:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Instance spawned successfully.
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:22:29 user nova-compute[74233]: INFO nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Took 6.18 seconds to spawn the instance on the hypervisor.
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-1b1db295-36dd-4687-9d55-606c9394cf3a req-f7604eae-09d5-4e4d-840f-9de5806206f9 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1b1db295-36dd-4687-9d55-606c9394cf3a req-f7604eae-09d5-4e4d-840f-9de5806206f9 service nova] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1b1db295-36dd-4687-9d55-606c9394cf3a req-f7604eae-09d5-4e4d-840f-9de5806206f9 service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1b1db295-36dd-4687-9d55-606c9394cf3a req-f7604eae-09d5-4e4d-840f-9de5806206f9 service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:29 user nova-compute[74233]: DEBUG nova.compute.manager [req-1b1db295-36dd-4687-9d55-606c9394cf3a req-f7604eae-09d5-4e4d-840f-9de5806206f9 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] No waiting events found dispatching network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:29 user nova-compute[74233]: WARNING nova.compute.manager [req-1b1db295-36dd-4687-9d55-606c9394cf3a req-f7604eae-09d5-4e4d-840f-9de5806206f9 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received unexpected event network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac for instance with vm_state building and task_state spawning.
Oct 20 18:22:29 user nova-compute[74233]: INFO nova.compute.manager [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Took 7.39 seconds to build instance.
Oct 20 18:22:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-95e9d2d7-723f-47bc-b3ca-9a329fe614e3 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.497s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-changed-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Refreshing instance network info cache due to event network-changed-de94c390-2e4c-4ea8-9456-e9f8b242a745. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] Acquiring lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] Acquired lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG nova.network.neutron [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Refreshing network info cache for port de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG nova.network.neutron [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updated VIF entry in instance network info cache for port de94c390-2e4c-4ea8-9456-e9f8b242a745. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG nova.network.neutron [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updating instance_info_cache with network_info: [{"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-260b1b50-ab2a-47f5-bbf6-020d3e3ba107 req-64aa3f50-2470-4587-bae2-56a15b2735c0 service nova] Releasing lock "refresh_cache-debfd120-e237-4afa-9b36-2bed99e48379" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:35 user nova-compute[74233]: INFO nova.compute.manager [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Rebuilding instance
Oct 20 18:22:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-14ee3f2e-9fd0-4e9f-90bc-cdbd9c15c251 req-ff2eabc4-b1ed-4950-912b-969b64672d02 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-unplugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-14ee3f2e-9fd0-4e9f-90bc-cdbd9c15c251 req-ff2eabc4-b1ed-4950-912b-969b64672d02 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-14ee3f2e-9fd0-4e9f-90bc-cdbd9c15c251 req-ff2eabc4-b1ed-4950-912b-969b64672d02 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-14ee3f2e-9fd0-4e9f-90bc-cdbd9c15c251 req-ff2eabc4-b1ed-4950-912b-969b64672d02 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-14ee3f2e-9fd0-4e9f-90bc-cdbd9c15c251 req-ff2eabc4-b1ed-4950-912b-969b64672d02 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-unplugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:35 user nova-compute[74233]: WARNING nova.compute.manager [req-14ee3f2e-9fd0-4e9f-90bc-cdbd9c15c251 req-ff2eabc4-b1ed-4950-912b-969b64672d02 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-unplugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state active and task_state rebuilding.
Oct 20 18:22:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance destroyed successfully.
Oct 20 18:22:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance destroyed successfully.
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1762481964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382179192',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdxvKw/u2/yYNcSmoIIw3OhtKwd9N5pLEhMwvhcYInn0YmmQEqlhhtUrpuAHa9qB1NKrhaBPRWW5SC94JQy/O/YrBBmdOi7KhyHAC4xFBV4fmIstcf3tZGhxFTrqMLAA==',key_name='tempest-keypair-1819207714',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f91646be9384ebdab36bc6c813cb56e',ramdisk_id='',reservation_id='r-0l0w4hia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1458618408',owner_user_name='tempest-ServerActionsV293TestJSON-1458618408-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9207f9f82e346ec86d29521dc93e221',uuid=debfd120-e237-4afa-9b36-2bed99e48379,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converting VIF {"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde94c390-2e, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33e95d12-ccf2-4960-b45a-fea47f4d72a5) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:36 user nova-compute[74233]: INFO os_vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e')
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6b6153-00af-4a56-9623-f9a874ccb97f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:22:36 user nova-compute[74233]: No targets found.
Oct 20 18:22:36 user nova-compute[74233]: iSNS:
Oct 20 18:22:36 user nova-compute[74233]: No targets found.
Oct 20 18:22:36 user nova-compute[74233]: STATIC:
Oct 20 18:22:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:22:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:22:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:22:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:36 user nova-compute[74233]: FIRMWARE:
Oct 20 18:22:36 user nova-compute[74233]: No targets found.
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:22:36 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:22:36 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bbe50f-7f2a-4d83-9dec-065f51876e2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d4cb6-b136-4eac-9117-9d22cf60b7dc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09f9661-58d5-47d6-a5fc-320cce805c48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af9d9fe-8065-42b8-8256-bbe45e0f4edd]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03127620-84e5-437b-892c-89d0b4c2f103]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d02e1-aa87-4cd1-85d8-cb2216c636a1]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40aac1a-f096-4765-80a2-981aec6ccba0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --logout" returned: 0 in 0.154s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[178c23d0-5523-49bf-a7a4-cb753c0aa4dc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]
Oct 20 18:22:36 user nova-compute[74233]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f8cf7-de82-4038-adac-61dee901dbee]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== disconnect_volume: return (446ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:22:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Deleting instance files /opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379_del
Oct 20 18:22:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Deletion of /opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379_del complete
Oct 20 18:22:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance debfd120-e237-4afa-9b36-2bed99e48379 could not be found.
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c205c-12d2-4264-a0da-8e7fc247604d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:22:36 user nova-compute[74233]: No targets found.
Oct 20 18:22:36 user nova-compute[74233]: iSNS:
Oct 20 18:22:36 user nova-compute[74233]: No targets found.
Oct 20 18:22:36 user nova-compute[74233]: STATIC:
Oct 20 18:22:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:22:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:22:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:36 user nova-compute[74233]: FIRMWARE:
Oct 20 18:22:36 user nova-compute[74233]: No targets found.
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:22:36 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:22:36 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff727c-da5e-4c55-a400-57f2e1d44b6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15185b5f-2294-4060-a7be-812f8d51d6ad]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970648f70>, {}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Disconnecting from: [] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== disconnect_volume: return (66ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-d1a362cb-59f7-4086-b34c-81ccf3301ad2 req-30e7326c-438d-4155-ac6f-21059cbd6c65 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d1a362cb-59f7-4086-b34c-81ccf3301ad2 req-30e7326c-438d-4155-ac6f-21059cbd6c65 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d1a362cb-59f7-4086-b34c-81ccf3301ad2 req-30e7326c-438d-4155-ac6f-21059cbd6c65 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d1a362cb-59f7-4086-b34c-81ccf3301ad2 req-30e7326c-438d-4155-ac6f-21059cbd6c65 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-d1a362cb-59f7-4086-b34c-81ccf3301ad2 req-30e7326c-438d-4155-ac6f-21059cbd6c65 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:37 user nova-compute[74233]: WARNING nova.compute.manager [req-d1a362cb-59f7-4086-b34c-81ccf3301ad2 req-30e7326c-438d-4155-ac6f-21059cbd6c65 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state active and task_state rebuilding.
Oct 20 18:22:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Preparing to wait for external event volume-reimaged-600c0d7b-697c-467c-8d7e-061bd4cb2509 {{(pid=74233) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:22:45 user nova-compute[74233]: INFO nova.compute.claims [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Claim successful on node user
Oct 20 18:22:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:45 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:22:45 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:22:45 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2384d6c1-70b7-4418-b47c-a3596f9c2749]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:22:45 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1be5bd-dd93-4b85-a410-52aabe215bdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668] added
Oct 20 18:22:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789c1c6-077f-4e7a-acc6-9fe09c67820c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f80dda1-b05d-44ad-9bd4-6b94d0bb434a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmEGTip {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.network.neutron [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:22:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmEGTip" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab7aa9f-5650-4fe6-bed4-992b2ef3e5a4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFmEGTip'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be163be7-15d0-45a9-9cd6-7479e772b9ad]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21acd1c3-d14b-471c-9a8f-42e2db142951]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: INFO nova.virt.block_device [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Booting with volume 78618bd9-1c8d-4076-a12e-651178361bf2 at /dev/vda
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0144282-eea2-4f29-9f1e-5753e4b560ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]
Oct 20 18:22:45 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.
Oct 20 18:22:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58016642-6a2e-4de2-9b3c-cda5634d844f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.utils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a723c-ddb7-4e69-9aa3-ec008fb150a4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b85ea5-127c-4dd8-8da3-37139c1b62c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG nova.policy [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10447188fbd74b18ba64fc8e64d267c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b592b103d8084815bf6d3132c1215feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b54acb4-d0a4-4727-8177-00f735b4f8f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69e3a4c-eb31-4bfc-8c53-32a16a3ff17c]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54bb53b-2009-4ab9-bc06-43f3b14d52cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1211567-0287-47b1-add2-fdc5756966ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:22:46 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:22:46 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3aefa3-cb93-4d09-92fd-50a4fdeda9d3]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.utils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updating existing volume attachment record: fb9ad978-e8df-4757-bf0c-398289065e9d {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Successfully created port: 56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23663366533333333', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663366533333333', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:22:46 user nova-compute[74233]: DEBUG nova.objects.instance [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'flavor' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:22:47 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:22:47 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:22:47 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:22:47 user nova-compute[74233]:   <serial>0489f953-4e2a-46cc-8a04-b8ffe75a5668</serial>
Oct 20 18:22:47 user nova-compute[74233]: </disk>
Oct 20 18:22:47 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Successfully updated port: 56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquired lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-changed-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Refreshing instance network info cache due to event network-changed-56807116-38ed-4b60-9867-b9964dcbb67d. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] Acquiring lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No VIF found with MAC fa:16:3e:8f:cb:6c, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updating instance_info_cache with network_info: [{"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Releasing lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Instance network_info: |[{"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] Acquired lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Refreshing network info cache for port 56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:22:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-93436763-d6c0-41ed-8759-be917eb6bd43 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.058s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updated VIF entry in instance network info cache for port 56807116-38ed-4b60-9867-b9964dcbb67d. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:22:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updating instance_info_cache with network_info: [{"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8103e89e-f761-498c-b6be-c46b42104d78 req-893d2664-e698-446f-8dd8-d6cdb4c8bd33 service nova] Releasing lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Stashing vm_state: active {{(pid=74233) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 18:22:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:49 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:22:49 user nova-compute[74233]: INFO nova.compute.claims [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Claim successful on node user
Oct 20 18:22:49 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating resource usage from migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5
Oct 20 18:22:50 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.774s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:50 user nova-compute[74233]: INFO nova.compute.manager [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Migrating
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:50 user nova-compute[74233]: INFO nova.compute.rpcapi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Starting migrate_disk_and_power_off {{(pid=74233) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-1ca49371-723c-44e8-8e82-841fcbea47b1 req-7fda5b80-3c33-4ed2-9f52-5bace3aa9bfc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1ca49371-723c-44e8-8e82-841fcbea47b1 req-7fda5b80-3c33-4ed2-9f52-5bace3aa9bfc service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1ca49371-723c-44e8-8e82-841fcbea47b1 req-7fda5b80-3c33-4ed2-9f52-5bace3aa9bfc service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1ca49371-723c-44e8-8e82-841fcbea47b1 req-7fda5b80-3c33-4ed2-9f52-5bace3aa9bfc service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-1ca49371-723c-44e8-8e82-841fcbea47b1 req-7fda5b80-3c33-4ed2-9f52-5bace3aa9bfc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:51 user nova-compute[74233]: WARNING nova.compute.manager [req-1ca49371-723c-44e8-8e82-841fcbea47b1 req-7fda5b80-3c33-4ed2-9f52-5bace3aa9bfc service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state active and task_state resize_migrating.
Oct 20 18:22:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance destroyed successfully.
Oct 20 18:22:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b4ef092-a7, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcff4801-7838-4bb1-9de4-fc8fb9f691af) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:22:51 user nova-compute[74233]: INFO os_vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7')
Oct 20 18:22:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:51 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93209b9c-a854-4443-a308-e7fce26ef2dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:22:51 user nova-compute[74233]: No targets found.
Oct 20 18:22:51 user nova-compute[74233]: iSNS:
Oct 20 18:22:51 user nova-compute[74233]: No targets found.
Oct 20 18:22:51 user nova-compute[74233]: STATIC:
Oct 20 18:22:51 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:22:51 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:51 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:51 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:22:51 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:51 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:51 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:22:51 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:22:51 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:22:51 user nova-compute[74233]: FIRMWARE:
Oct 20 18:22:51 user nova-compute[74233]: No targets found.
Oct 20 18:22:51 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:22:51 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:22:51 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd70c8-e8f3-4d52-a82d-4ec2b884169b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e658b86-cb76-4ed0-94a6-540900f6f8c1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:51 user nova-compute[74233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:22:51 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:51 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:22:51 user nova-compute[74233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:22:51 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:22:51 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb98029c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2011046b-4fe6-4617-a7f2-404f89f285ef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f0ca0-74a4-41ef-8c2f-f7bf02866b94]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d3eb0-68d4-48f4-82a3-9f30e92ab43a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4004b8-f241-4704-a2fb-bb8c32c04866]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f74feb8-eff8-4ea7-ab50-8370ff64fd12]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8863e-b3e4-4a94-96c7-f16790bb0be8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]
Oct 20 18:22:52 user nova-compute[74233]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.
Oct 20 18:22:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de1b93-780a-4650-8430-071170baee79]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== disconnect_volume: return (318ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f_resize/disk /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "cp -r /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f_resize/disk /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk" returned: 0 in 0.308s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f_resize/disk.info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk.info {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "cp -r /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f_resize/disk.info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk.info" returned: 0 in 0.038s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-eafcf3ef-ca97-4e45-9700-ca1da004535b req-b1fd3574-f066-494e-973e-4d15da303195 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eafcf3ef-ca97-4e45-9700-ca1da004535b req-b1fd3574-f066-494e-973e-4d15da303195 service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eafcf3ef-ca97-4e45-9700-ca1da004535b req-b1fd3574-f066-494e-973e-4d15da303195 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eafcf3ef-ca97-4e45-9700-ca1da004535b req-b1fd3574-f066-494e-973e-4d15da303195 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-eafcf3ef-ca97-4e45-9700-ca1da004535b req-b1fd3574-f066-494e-973e-4d15da303195 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:22:53 user nova-compute[74233]: WARNING nova.compute.manager [req-eafcf3ef-ca97-4e45-9700-ca1da004535b req-b1fd3574-f066-494e-973e-4d15da303195 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state active and task_state resize_migrating.
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:53 user nova-compute[74233]: WARNING nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] While synchronizing instance power states, found 14 instances in the database and 12 instances on the hypervisor.
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 7bdc323f-b8a2-4924-86bf-b35b1d680027 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 9d8f3218-2a57-452f-8251-2d5591c9f09a {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 5b5e15d0-98d8-4f35-98ff-41e922792b05 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid a733ecd9-bafe-4cdd-84ce-b1ae4791b7da {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid debfd120-e237-4afa-9b36-2bed99e48379 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: INFO nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] During sync_power_state the instance has a pending task (resize_migrating). Skip.
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "debfd120-e237-4afa-9b36-2bed99e48379" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: INFO nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: debfd120-e237-4afa-9b36-2bed99e48379] During sync_power_state the instance has a pending task (rebuilding). Skip.
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "debfd120-e237-4afa-9b36-2bed99e48379" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Port 6b4ef092-a79c-40e6-98a2-e6a45f6044c3 binding to destination host user is already ACTIVE {{(pid=74233) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:22:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG os_brick.utils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ddadf-e89d-4ee6-8e89-7a483c0d7389]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[266dfe29-c37d-4999-bc94-16a6e8ccb403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4c608e-9b00-492a-a805-9f65248e0a09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79902c88-591e-4353-85be-f3d311f395c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:22:54 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:22:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc2e26-9ae3-4518-8cad-cbeb4e1459c4]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:22:54 user nova-compute[74233]: DEBUG os_brick.utils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:22:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:22:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:22:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:23:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:23:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:00 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:23:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:05 user nova-compute[74233]: INFO nova.compute.manager [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Terminating instance
Oct 20 18:23:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:23:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-3442aa86-0857-4509-8fcc-958163faf81b req-eb5f36fa-14ed-46d4-a1bb-5ea4e3667d42 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3442aa86-0857-4509-8fcc-958163faf81b req-eb5f36fa-14ed-46d4-a1bb-5ea4e3667d42 service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3442aa86-0857-4509-8fcc-958163faf81b req-eb5f36fa-14ed-46d4-a1bb-5ea4e3667d42 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3442aa86-0857-4509-8fcc-958163faf81b req-eb5f36fa-14ed-46d4-a1bb-5ea4e3667d42 service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-3442aa86-0857-4509-8fcc-958163faf81b req-eb5f36fa-14ed-46d4-a1bb-5ea4e3667d42 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-3442aa86-0857-4509-8fcc-958163faf81b req-eb5f36fa-14ed-46d4-a1bb-5ea4e3667d42 service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-unplugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:23:06 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:06 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=24.825897216796875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:06 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Instance destroyed successfully.
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.objects.instance [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'resources' on Instance uuid bae683b9-94e9-4e4f-9621-93c2410d2351 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839955891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839955891',id=25,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-n78n7z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:21:19Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=bae683b9-94e9-4e4f-9621-93c2410d2351,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "address": "fa:16:3e:50:9c:7a", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39e7f593-91", "ovs_interfaceid": "39e7f593-9184-4b4d-9108-cc0f096e1a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_vif [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39e7f593-91, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e1219a0-2aa4-4beb-ad11-f3556f1a2aa2) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:06 user nova-compute[74233]: INFO os_vif [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:9c:7a,bridge_name='br-int',has_traffic_filtering=True,id=39e7f593-9184-4b4d-9108-cc0f096e1a57,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39e7f593-91')
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPFEiXjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:06 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[180efb7e-836c-42d5-a493-ba069ef52490]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:23:06 user nova-compute[74233]: No targets found.
Oct 20 18:23:06 user nova-compute[74233]: iSNS:
Oct 20 18:23:06 user nova-compute[74233]: No targets found.
Oct 20 18:23:06 user nova-compute[74233]: STATIC:
Oct 20 18:23:06 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3
Oct 20 18:23:06 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:23:06 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:23:06 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:23:06 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:23:06 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:23:06 user nova-compute[74233]: FIRMWARE:
Oct 20 18:23:06 user nova-compute[74233]: No targets found.
Oct 20 18:23:06 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:23:06 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:23:06 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1e83f4-dd3d-4ae3-959d-a5f01b2f1446]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Applying migration context for instance 6d03ff84-b768-404f-a319-dde83c0d334f as it has an incoming, in-progress migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5. Migration status is post-migrating {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 18:23:06 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating resource usage from migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f11352-e478-4c46-b96c-ecf11a0159b3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:23:06 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:06 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 (non-flash)
Oct 20 18:23:06 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:06 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970781630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1699bcf-1238-4f96-8b5b-d7c7d96d8be4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24316472-f6cf-4dca-911b-2ab6e6596563]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 7bdc323f-b8a2-4924-86bf-b35b1d680027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance bae683b9-94e9-4e4f-9621-93c2410d2351 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance debfd120-e237-4afa-9b36-2bed99e48379 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5b5e15d0-98d8-4f35-98ff-41e922792b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a733ecd9-bafe-4cdd-84ce-b1ae4791b7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c0c7a0-ea1f-41b5-9004-2c5c1c20814c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea5dea-95c9-4617-8b14-444eb1cb7a89]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7919eefc-4b8d-4492-b73b-648085c46e2d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1117f3f3-0673-4567-82ba-131c9477c37e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260]
Oct 20 18:23:06 user nova-compute[74233]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3, portal: 172.16.0.220,3260] successful.
Oct 20 18:23:06 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5ce6f-eeb9-4cd7-98c6-873e4f450eb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc600b51-07bc-47c0-a206-567ca4f4fd21]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== disconnect_volume: return (321ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:23:06 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Deleting instance files /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351_del
Oct 20 18:23:06 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Deletion of /opt/stack/data/nova/instances/bae683b9-94e9-4e4f-9621-93c2410d2351_del complete
Oct 20 18:23:06 user nova-compute[74233]: INFO nova.compute.manager [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:23:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:23:07 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Took 0.48 seconds to deallocate network for instance.
Oct 20 18:23:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-cb87475e-40b4-4f97-9cf3-858313851037 req-0f912008-2849-4830-8419-866f6a7dc63e service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-deleted-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-356e6a9e-7149-4c7c-8886-87266d3ee31e req-04f467e6-2bfe-4da2-b6c2-1d800807581e service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-356e6a9e-7149-4c7c-8886-87266d3ee31e req-04f467e6-2bfe-4da2-b6c2-1d800807581e service nova] Acquiring lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-356e6a9e-7149-4c7c-8886-87266d3ee31e req-04f467e6-2bfe-4da2-b6c2-1d800807581e service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-356e6a9e-7149-4c7c-8886-87266d3ee31e req-04f467e6-2bfe-4da2-b6c2-1d800807581e service nova] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG nova.compute.manager [req-356e6a9e-7149-4c7c-8886-87266d3ee31e req-04f467e6-2bfe-4da2-b6c2-1d800807581e service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] No waiting events found dispatching network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:07 user nova-compute[74233]: WARNING nova.compute.manager [req-356e6a9e-7149-4c7c-8886-87266d3ee31e req-04f467e6-2bfe-4da2-b6c2-1d800807581e service nova] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Received unexpected event network-vif-plugged-39e7f593-9184-4b4d-9108-cc0f096e1a57 for instance with vm_state active and task_state deleting.
Oct 20 18:23:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:23:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updating instance_info_cache with network_info: [{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:23:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:23:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Starting finish_migration {{(pid=74233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:23:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Creating image(s)
Oct 20 18:23:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk. size=21474836480 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk 21474836480 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk 21474836480" returned: 0 in 0.047s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Ensure instance console log exists: /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start _get_guest_xml network_info=[{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'fb740f24-2274-4dd7-9373-f1a22f6bab3d', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6d03ff84-b768-404f-a319-dde83c0d334f', 'attached_at': '2023-10-20T18:23:12.000000', 'detached_at': '', 'volume_id': '0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'serial': '0489f953-4e2a-46cc-8a04-b8ffe75a5668'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:23:13 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:13 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:13 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:13 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:13 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f4935-f512-4f65-a8b5-777b8bda466b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:23:13 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c13197-94f5-45d3-9739-f3fbf8741a5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668] added
Oct 20 18:23:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a038f286-77d3-4316-9e2c-13668542b7cb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5888978-e901-41da-aedb-25263ec234ca]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmEGTip {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmEGTip" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0157c0-8838-47e7-96db-b68b31589d73]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFmEGTip'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de110a0-f014-47a9-a0a5-e413c87015e4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d616e6f8-4c9d-43d9-960a-ec6fe3c3a3e8]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a77e7c-eec3-46c8-aa77-3784ac7d34cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]
Oct 20 18:23:13 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.
Oct 20 18:23:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e838f-6678-4313-a47c-df02d46d8e1e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2200b8f-7781-4c0d-8891-0d5cdc4e26ce]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:13 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:13 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:13 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d0ff5-6aad-4759-8180-992f711bf601]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23663366533333333', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663366533333333', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:23:14 user nova-compute[74233]:   <uuid>6d03ff84-b768-404f-a319-dde83c0d334f</uuid>
Oct 20 18:23:14 user nova-compute[74233]:   <name>instance-0000001b</name>
Oct 20 18:23:14 user nova-compute[74233]:   <memory>2097152</memory>
Oct 20 18:23:14 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:23:14 user nova-compute[74233]:   <metadata>
Oct 20 18:23:14 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:23:14 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:23:14 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherB-server-906554630</nova:name>
Oct 20 18:23:14 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:23:13</nova:creationTime>
Oct 20 18:23:14 user nova-compute[74233]:       <nova:flavor name="m1.small">
Oct 20 18:23:14 user nova-compute[74233]:         <nova:memory>2048</nova:memory>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:disk>20</nova:disk>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:23:14 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:23:14 user nova-compute[74233]:       <nova:owner>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:user uuid="5560a7c568e54a76b94eb889229c78a5">tempest-ServerActionsTestOtherB-2120896258-project-member</nova:user>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:project uuid="c98418bca8ed4de094d230072e355984">tempest-ServerActionsTestOtherB-2120896258</nova:project>
Oct 20 18:23:14 user nova-compute[74233]:       </nova:owner>
Oct 20 18:23:14 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:23:14 user nova-compute[74233]:       <nova:ports>
Oct 20 18:23:14 user nova-compute[74233]:         <nova:port uuid="6b4ef092-a79c-40e6-98a2-e6a45f6044c3">
Oct 20 18:23:14 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 18:23:14 user nova-compute[74233]:         </nova:port>
Oct 20 18:23:14 user nova-compute[74233]:       </nova:ports>
Oct 20 18:23:14 user nova-compute[74233]:     </nova:instance>
Oct 20 18:23:14 user nova-compute[74233]:   </metadata>
Oct 20 18:23:14 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:23:14 user nova-compute[74233]:     <system>
Oct 20 18:23:14 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:23:14 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:23:14 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:23:14 user nova-compute[74233]:       <entry name="serial">6d03ff84-b768-404f-a319-dde83c0d334f</entry>
Oct 20 18:23:14 user nova-compute[74233]:       <entry name="uuid">6d03ff84-b768-404f-a319-dde83c0d334f</entry>
Oct 20 18:23:14 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:23:14 user nova-compute[74233]:     </system>
Oct 20 18:23:14 user nova-compute[74233]:   </sysinfo>
Oct 20 18:23:14 user nova-compute[74233]:   <os>
Oct 20 18:23:14 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:23:14 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:23:14 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:23:14 user nova-compute[74233]:   </os>
Oct 20 18:23:14 user nova-compute[74233]:   <features>
Oct 20 18:23:14 user nova-compute[74233]:     <acpi/>
Oct 20 18:23:14 user nova-compute[74233]:     <apic/>
Oct 20 18:23:14 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:23:14 user nova-compute[74233]:   </features>
Oct 20 18:23:14 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:23:14 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:23:14 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:23:14 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:23:14 user nova-compute[74233]:   </clock>
Oct 20 18:23:14 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:23:14 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:23:14 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:23:14 user nova-compute[74233]:   </cpu>
Oct 20 18:23:14 user nova-compute[74233]:   <devices>
Oct 20 18:23:14 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:23:14 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:23:14 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk"/>
Oct 20 18:23:14 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:23:14 user nova-compute[74233]:     </disk>
Oct 20 18:23:14 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:23:14 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:23:14 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:23:14 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:23:14 user nova-compute[74233]:       <serial>0489f953-4e2a-46cc-8a04-b8ffe75a5668</serial>
Oct 20 18:23:14 user nova-compute[74233]:     </disk>
Oct 20 18:23:14 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:23:14 user nova-compute[74233]:       <mac address="fa:16:3e:8f:cb:6c"/>
Oct 20 18:23:14 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:14 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:23:14 user nova-compute[74233]:       <target dev="tap6b4ef092-a7"/>
Oct 20 18:23:14 user nova-compute[74233]:     </interface>
Oct 20 18:23:14 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:23:14 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/console.log" append="off"/>
Oct 20 18:23:14 user nova-compute[74233]:     </serial>
Oct 20 18:23:14 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:23:14 user nova-compute[74233]:     <video>
Oct 20 18:23:14 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:14 user nova-compute[74233]:     </video>
Oct 20 18:23:14 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:23:14 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:23:14 user nova-compute[74233]:     </rng>
Oct 20 18:23:14 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:23:14 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:23:14 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:23:14 user nova-compute[74233]:     </memballoon>
Oct 20 18:23:14 user nova-compute[74233]:   </devices>
Oct 20 18:23:14 user nova-compute[74233]: </domain>
Oct 20 18:23:14 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1514054828-network", "vif_mac": "fa:16:3e:8f:cb:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG os_vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a36e68a7-177f-5434-ae2c-b1f7390ca3f0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b4ef092-a7, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b4ef092-a7, col_values=(('qos', UUID('b22a52d4-a472-468b-b297-159d13cafa93')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b4ef092-a7, col_values=(('external_ids', {'iface-id': '6b4ef092-a79c-40e6-98a2-e6a45f6044c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:cb:6c', 'vm-uuid': '6d03ff84-b768-404f-a319-dde83c0d334f'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:14 user nova-compute[74233]: INFO os_vif [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7')
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] No VIF found with MAC fa:16:3e:8f:cb:6c, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:23:15 user nova-compute[74233]: INFO nova.compute.claims [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Claim successful on node user
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:23:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.policy [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15b21695cdfe4b4299fb08403ed15ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e847f3ff044181bb615138361ec8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:23:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Creating image(s)
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-83fe5e00-973e-4127-b2e4-7d57164b2086 req-c3fb876c-84f8-4ec9-9d71-373d390ab90c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-83fe5e00-973e-4127-b2e4-7d57164b2086 req-c3fb876c-84f8-4ec9-9d71-373d390ab90c service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-83fe5e00-973e-4127-b2e4-7d57164b2086 req-c3fb876c-84f8-4ec9-9d71-373d390ab90c service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-83fe5e00-973e-4127-b2e4-7d57164b2086 req-c3fb876c-84f8-4ec9-9d71-373d390ab90c service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.compute.manager [req-83fe5e00-973e-4127-b2e4-7d57164b2086 req-c3fb876c-84f8-4ec9-9d71-373d390ab90c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:16 user nova-compute[74233]: WARNING nova.compute.manager [req-83fe5e00-973e-4127-b2e4-7d57164b2086 req-c3fb876c-84f8-4ec9-9d71-373d390ab90c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state active and task_state resize_finish.
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk 1073741824" returned: 0 in 0.063s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Successfully created port: 157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.209s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Cannot resize image /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Ensure instance console log exists: /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Successfully updated port: 157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing instance network info cache due to event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance network_info: |[{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Start _get_guest_xml network_info=[{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:23:17 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:17 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266827241',display_name='tempest-ServerRescueNegativeTestJSON-server-1266827241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266827241',id=35,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAnd2569lRXlRuOBKhGNt53usojGkjn2y9Rrev1olWo2VXMzLNTKwAbsZhdkHOGj+k8dBqGvILvC2hTQNn+lB3TXMN83LM2EfXEc/y6YHPaJDstVx51RQ6RNE78Ol0bmg==',key_name='tempest-keypair-1823172263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-kullwdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=2753b305-f0cb-409c-b66a-e06a99378c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'pci_devices' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:23:17 user nova-compute[74233]:   <uuid>2753b305-f0cb-409c-b66a-e06a99378c08</uuid>
Oct 20 18:23:17 user nova-compute[74233]:   <name>instance-00000023</name>
Oct 20 18:23:17 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:23:17 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:23:17 user nova-compute[74233]:   <metadata>
Oct 20 18:23:17 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:23:17 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:23:17 user nova-compute[74233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1266827241</nova:name>
Oct 20 18:23:17 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:23:17</nova:creationTime>
Oct 20 18:23:17 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:23:17 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:23:17 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:23:17 user nova-compute[74233]:       <nova:owner>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:user uuid="15b21695cdfe4b4299fb08403ed15ddd">tempest-ServerRescueNegativeTestJSON-226182355-project-member</nova:user>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:project uuid="51e847f3ff044181bb615138361ec8da">tempest-ServerRescueNegativeTestJSON-226182355</nova:project>
Oct 20 18:23:17 user nova-compute[74233]:       </nova:owner>
Oct 20 18:23:17 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:23:17 user nova-compute[74233]:       <nova:ports>
Oct 20 18:23:17 user nova-compute[74233]:         <nova:port uuid="157e864c-8ac5-422d-a7a1-7252ef76cee1">
Oct 20 18:23:17 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:23:17 user nova-compute[74233]:         </nova:port>
Oct 20 18:23:17 user nova-compute[74233]:       </nova:ports>
Oct 20 18:23:17 user nova-compute[74233]:     </nova:instance>
Oct 20 18:23:17 user nova-compute[74233]:   </metadata>
Oct 20 18:23:17 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:23:17 user nova-compute[74233]:     <system>
Oct 20 18:23:17 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:23:17 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:23:17 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:23:17 user nova-compute[74233]:       <entry name="serial">2753b305-f0cb-409c-b66a-e06a99378c08</entry>
Oct 20 18:23:17 user nova-compute[74233]:       <entry name="uuid">2753b305-f0cb-409c-b66a-e06a99378c08</entry>
Oct 20 18:23:17 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:23:17 user nova-compute[74233]:     </system>
Oct 20 18:23:17 user nova-compute[74233]:   </sysinfo>
Oct 20 18:23:17 user nova-compute[74233]:   <os>
Oct 20 18:23:17 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:23:17 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:23:17 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:23:17 user nova-compute[74233]:   </os>
Oct 20 18:23:17 user nova-compute[74233]:   <features>
Oct 20 18:23:17 user nova-compute[74233]:     <acpi/>
Oct 20 18:23:17 user nova-compute[74233]:     <apic/>
Oct 20 18:23:17 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:23:17 user nova-compute[74233]:   </features>
Oct 20 18:23:17 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:23:17 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:23:17 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:23:17 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:23:17 user nova-compute[74233]:   </clock>
Oct 20 18:23:17 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:23:17 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:23:17 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:23:17 user nova-compute[74233]:   </cpu>
Oct 20 18:23:17 user nova-compute[74233]:   <devices>
Oct 20 18:23:17 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:23:17 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:23:17 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk"/>
Oct 20 18:23:17 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:23:17 user nova-compute[74233]:     </disk>
Oct 20 18:23:17 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:23:17 user nova-compute[74233]:       <mac address="fa:16:3e:cb:cf:83"/>
Oct 20 18:23:17 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:17 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:23:17 user nova-compute[74233]:       <target dev="tap157e864c-8a"/>
Oct 20 18:23:17 user nova-compute[74233]:     </interface>
Oct 20 18:23:17 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:23:17 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/console.log" append="off"/>
Oct 20 18:23:17 user nova-compute[74233]:     </serial>
Oct 20 18:23:17 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:23:17 user nova-compute[74233]:     <video>
Oct 20 18:23:17 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:17 user nova-compute[74233]:     </video>
Oct 20 18:23:17 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:23:17 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:23:17 user nova-compute[74233]:     </rng>
Oct 20 18:23:17 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:23:17 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:23:17 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:23:17 user nova-compute[74233]:     </memballoon>
Oct 20 18:23:17 user nova-compute[74233]:   </devices>
Oct 20 18:23:17 user nova-compute[74233]: </domain>
Oct 20 18:23:17 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266827241',display_name='tempest-ServerRescueNegativeTestJSON-server-1266827241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266827241',id=35,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAnd2569lRXlRuOBKhGNt53usojGkjn2y9Rrev1olWo2VXMzLNTKwAbsZhdkHOGj+k8dBqGvILvC2hTQNn+lB3TXMN83LM2EfXEc/y6YHPaJDstVx51RQ6RNE78Ol0bmg==',key_name='tempest-keypair-1823172263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-kullwdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=2753b305-f0cb-409c-b66a-e06a99378c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG os_vif [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b66e67a8-eed9-573c-8b1c-df7fc207290f', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap157e864c-8a, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap157e864c-8a, col_values=(('qos', UUID('58382a66-e781-42a4-ab71-dae5094336d1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap157e864c-8a, col_values=(('external_ids', {'iface-id': '157e864c-8ac5-422d-a7a1-7252ef76cee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:cf:83', 'vm-uuid': '2753b305-f0cb-409c-b66a-e06a99378c08'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:17 user nova-compute[74233]: INFO os_vif [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a')
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:cb:cf:83, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updated VIF entry in instance network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:23:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-db6e1c7c-7691-433a-ace1-a580b478bbbf req-f43b1207-62f7-4958-9eaa-d377998b35cc service nova] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:23:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance running successfully.
Oct 20 18:23:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Failed to set time: agent not configured {{(pid=74233) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d2642592-46c2-4768-b794-eebb12ad4e67 tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] finish_migration finished successfully. {{(pid=74233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-b18cc666-d143-467e-9e9a-71b92399fd6a req-fbf0613c-7ab2-4868-9574-3db56d9700c6 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b18cc666-d143-467e-9e9a-71b92399fd6a req-fbf0613c-7ab2-4868-9574-3db56d9700c6 service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b18cc666-d143-467e-9e9a-71b92399fd6a req-fbf0613c-7ab2-4868-9574-3db56d9700c6 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-b18cc666-d143-467e-9e9a-71b92399fd6a req-fbf0613c-7ab2-4868-9574-3db56d9700c6 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:18 user nova-compute[74233]: DEBUG nova.compute.manager [req-b18cc666-d143-467e-9e9a-71b92399fd6a req-fbf0613c-7ab2-4868-9574-3db56d9700c6 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:18 user nova-compute[74233]: WARNING nova.compute.manager [req-b18cc666-d143-467e-9e9a-71b92399fd6a req-fbf0613c-7ab2-4868-9574-3db56d9700c6 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state active and task_state resize_finish.
Oct 20 18:23:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-09c8fdbd-1dc9-4a0c-907f-b62368625a19 req-70e8c69e-51aa-413a-9d24-d30048661008 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-09c8fdbd-1dc9-4a0c-907f-b62368625a19 req-70e8c69e-51aa-413a-9d24-d30048661008 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-09c8fdbd-1dc9-4a0c-907f-b62368625a19 req-70e8c69e-51aa-413a-9d24-d30048661008 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-09c8fdbd-1dc9-4a0c-907f-b62368625a19 req-70e8c69e-51aa-413a-9d24-d30048661008 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-09c8fdbd-1dc9-4a0c-907f-b62368625a19 req-70e8c69e-51aa-413a-9d24-d30048661008 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:19 user nova-compute[74233]: WARNING nova.compute.manager [req-09c8fdbd-1dc9-4a0c-907f-b62368625a19 req-70e8c69e-51aa-413a-9d24-d30048661008 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state building and task_state spawning.
Oct 20 18:23:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:23:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Creating image(s)
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Ensure instance console log exists: /opt/stack/data/nova/instances/a733ecd9-bafe-4cdd-84ce-b1ae4791b7da/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Start _get_guest_xml network_info=[{"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'fb9ad978-e8df-4757-bf0c-398289065e9d', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a733ecd9-bafe-4cdd-84ce-b1ae4791b7da', 'attached_at': '', 'detached_at': '', 'volume_id': '78618bd9-1c8d-4076-a12e-651178361bf2', 'serial': '78618bd9-1c8d-4076-a12e-651178361bf2'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:23:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:20 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:20 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:20 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fe68e4-682a-42c9-b8b9-d1fe37509eee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:23:20 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1659b77d-4ab2-4c86-9cb5-de2325f20690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2] added
Oct 20 18:23:20 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5429a-ea5d-47d5-b53e-b297917295e7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc51e04-b7fa-4f31-aa58-99514874e760]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZOVJFyo {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZOVJFyo" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59fd0d4-efa3-4bcd-b97a-d28677b5326c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fZOVJFyo'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e690490-686c-4475-8d1a-361f268c7d3a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17b89e8-8dc9-4976-b838-8f21a62c8edb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f5c68b-c929-4a3a-ad57-ebdd704780b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]
Oct 20 18:23:20 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.
Oct 20 18:23:20 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961ee33-26a9-4628-9e88-b322a9e073b0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd1010-d550-4a6c-9132-2e235e4ed436]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:20 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d37f37-841c-4aa7-b8d0-df33706f969b]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:23:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-0a18b0ca-d49e-4331-b174-5baeec7d4817 req-cc237075-cf02-430b-8478-8e306606324c service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0a18b0ca-d49e-4331-b174-5baeec7d4817 req-cc237075-cf02-430b-8478-8e306606324c service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0a18b0ca-d49e-4331-b174-5baeec7d4817 req-cc237075-cf02-430b-8478-8e306606324c service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0a18b0ca-d49e-4331-b174-5baeec7d4817 req-cc237075-cf02-430b-8478-8e306606324c service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-0a18b0ca-d49e-4331-b174-5baeec7d4817 req-cc237075-cf02-430b-8478-8e306606324c service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:21 user nova-compute[74233]: WARNING nova.compute.manager [req-0a18b0ca-d49e-4331-b174-5baeec7d4817 req-cc237075-cf02-430b-8478-8e306606324c service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state building and task_state spawning.
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:23:21 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance spawned successfully.
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:21 user nova-compute[74233]: INFO nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:23:21 user nova-compute[74233]: INFO nova.compute.manager [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Took 6.59 seconds to build instance.
Oct 20 18:23:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b48a70fd-e6c8-4d3b-8e4b-7a3a0df85c9c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.790s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23634613631313966', 'path': '/dev/sdd'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613631313966', 'path': '/dev/sdd'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-799439366',display_name='tempest-TestVolumeBootPattern-server-799439366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-799439366',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-lzhz0vef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:46Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=a733ecd9-bafe-4cdd-84ce-b1ae4791b7da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:21 user nova-compute[74233]: DEBUG nova.objects.instance [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'pci_devices' on Instance uuid a733ecd9-bafe-4cdd-84ce-b1ae4791b7da {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:23:22 user nova-compute[74233]:   <uuid>a733ecd9-bafe-4cdd-84ce-b1ae4791b7da</uuid>
Oct 20 18:23:22 user nova-compute[74233]:   <name>instance-00000022</name>
Oct 20 18:23:22 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:23:22 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:23:22 user nova-compute[74233]:   <metadata>
Oct 20 18:23:22 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:23:22 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:23:22 user nova-compute[74233]:       <nova:name>tempest-TestVolumeBootPattern-server-799439366</nova:name>
Oct 20 18:23:22 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:23:20</nova:creationTime>
Oct 20 18:23:22 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:23:22 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:23:22 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:23:22 user nova-compute[74233]:       <nova:owner>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:user uuid="10447188fbd74b18ba64fc8e64d267c6">tempest-TestVolumeBootPattern-2006411708-project-member</nova:user>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:project uuid="b592b103d8084815bf6d3132c1215feb">tempest-TestVolumeBootPattern-2006411708</nova:project>
Oct 20 18:23:22 user nova-compute[74233]:       </nova:owner>
Oct 20 18:23:22 user nova-compute[74233]:       <nova:ports>
Oct 20 18:23:22 user nova-compute[74233]:         <nova:port uuid="56807116-38ed-4b60-9867-b9964dcbb67d">
Oct 20 18:23:22 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:23:22 user nova-compute[74233]:         </nova:port>
Oct 20 18:23:22 user nova-compute[74233]:       </nova:ports>
Oct 20 18:23:22 user nova-compute[74233]:     </nova:instance>
Oct 20 18:23:22 user nova-compute[74233]:   </metadata>
Oct 20 18:23:22 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:23:22 user nova-compute[74233]:     <system>
Oct 20 18:23:22 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:23:22 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:23:22 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:23:22 user nova-compute[74233]:       <entry name="serial">a733ecd9-bafe-4cdd-84ce-b1ae4791b7da</entry>
Oct 20 18:23:22 user nova-compute[74233]:       <entry name="uuid">a733ecd9-bafe-4cdd-84ce-b1ae4791b7da</entry>
Oct 20 18:23:22 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:23:22 user nova-compute[74233]:     </system>
Oct 20 18:23:22 user nova-compute[74233]:   </sysinfo>
Oct 20 18:23:22 user nova-compute[74233]:   <os>
Oct 20 18:23:22 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:23:22 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:23:22 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:23:22 user nova-compute[74233]:   </os>
Oct 20 18:23:22 user nova-compute[74233]:   <features>
Oct 20 18:23:22 user nova-compute[74233]:     <acpi/>
Oct 20 18:23:22 user nova-compute[74233]:     <apic/>
Oct 20 18:23:22 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:23:22 user nova-compute[74233]:   </features>
Oct 20 18:23:22 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:23:22 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:23:22 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:23:22 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:23:22 user nova-compute[74233]:   </clock>
Oct 20 18:23:22 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:23:22 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:23:22 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:23:22 user nova-compute[74233]:   </cpu>
Oct 20 18:23:22 user nova-compute[74233]:   <devices>
Oct 20 18:23:22 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:23:22 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:23:22 user nova-compute[74233]:       <source dev="/dev/sdd"/>
Oct 20 18:23:22 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:23:22 user nova-compute[74233]:       <serial>78618bd9-1c8d-4076-a12e-651178361bf2</serial>
Oct 20 18:23:22 user nova-compute[74233]:     </disk>
Oct 20 18:23:22 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:23:22 user nova-compute[74233]:       <mac address="fa:16:3e:6a:1d:9e"/>
Oct 20 18:23:22 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:22 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:23:22 user nova-compute[74233]:       <target dev="tap56807116-38"/>
Oct 20 18:23:22 user nova-compute[74233]:     </interface>
Oct 20 18:23:22 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:23:22 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/a733ecd9-bafe-4cdd-84ce-b1ae4791b7da/console.log" append="off"/>
Oct 20 18:23:22 user nova-compute[74233]:     </serial>
Oct 20 18:23:22 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:23:22 user nova-compute[74233]:     <video>
Oct 20 18:23:22 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:22 user nova-compute[74233]:     </video>
Oct 20 18:23:22 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:23:22 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:23:22 user nova-compute[74233]:     </rng>
Oct 20 18:23:22 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:23:22 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:23:22 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:23:22 user nova-compute[74233]:     </memballoon>
Oct 20 18:23:22 user nova-compute[74233]:   </devices>
Oct 20 18:23:22 user nova-compute[74233]: </domain>
Oct 20 18:23:22 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-799439366',display_name='tempest-TestVolumeBootPattern-server-799439366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-799439366',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-lzhz0vef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:22:46Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=a733ecd9-bafe-4cdd-84ce-b1ae4791b7da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG os_vif [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b26d121d-cfcf-52e6-a27f-736f2be90ec0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56807116-38, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56807116-38, col_values=(('qos', UUID('2844c1e1-f7c9-4721-bb75-ab8816cc86ff')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56807116-38, col_values=(('external_ids', {'iface-id': '56807116-38ed-4b60-9867-b9964dcbb67d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:1d:9e', 'vm-uuid': 'a733ecd9-bafe-4cdd-84ce-b1ae4791b7da'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:22 user nova-compute[74233]: INFO os_vif [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38')
Oct 20 18:23:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:23:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No VIF found with MAC fa:16:3e:6a:1d:9e, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:23:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-7a48c4b4-76dd-4b87-ba2d-e584ee52f47d req-0e3b0455-81c6-4f5b-959e-3b3870e0fcaf service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7a48c4b4-76dd-4b87-ba2d-e584ee52f47d req-0e3b0455-81c6-4f5b-959e-3b3870e0fcaf service nova] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7a48c4b4-76dd-4b87-ba2d-e584ee52f47d req-0e3b0455-81c6-4f5b-959e-3b3870e0fcaf service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7a48c4b4-76dd-4b87-ba2d-e584ee52f47d req-0e3b0455-81c6-4f5b-959e-3b3870e0fcaf service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-7a48c4b4-76dd-4b87-ba2d-e584ee52f47d req-0e3b0455-81c6-4f5b-959e-3b3870e0fcaf service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] No waiting events found dispatching network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:24 user nova-compute[74233]: WARNING nova.compute.manager [req-7a48c4b4-76dd-4b87-ba2d-e584ee52f47d req-0e3b0455-81c6-4f5b-959e-3b3870e0fcaf service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received unexpected event network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d for instance with vm_state building and task_state spawning.
Oct 20 18:23:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:25 user nova-compute[74233]: INFO nova.compute.manager [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: bae683b9-94e9-4e4f-9621-93c2410d2351] Took 18.40 seconds to detach 1 volumes for instance.
Oct 20 18:23:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'flavor' on Instance uuid 5b5e15d0-98d8-4f35-98ff-41e922792b05 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-eeb1c1b9-d47f-4b28-95c1-21ded15b2ba3 req-d54b4308-14a0-4327-a849-3c5a00a07fd9 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eeb1c1b9-d47f-4b28-95c1-21ded15b2ba3 req-d54b4308-14a0-4327-a849-3c5a00a07fd9 service nova] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eeb1c1b9-d47f-4b28-95c1-21ded15b2ba3 req-d54b4308-14a0-4327-a849-3c5a00a07fd9 service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eeb1c1b9-d47f-4b28-95c1-21ded15b2ba3 req-d54b4308-14a0-4327-a849-3c5a00a07fd9 service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-eeb1c1b9-d47f-4b28-95c1-21ded15b2ba3 req-d54b4308-14a0-4327-a849-3c5a00a07fd9 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] No waiting events found dispatching network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:26 user nova-compute[74233]: WARNING nova.compute.manager [req-eeb1c1b9-d47f-4b28-95c1-21ded15b2ba3 req-d54b4308-14a0-4327-a849-3c5a00a07fd9 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received unexpected event network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d for instance with vm_state building and task_state spawning.
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:23:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Instance spawned successfully.
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.794s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:26 user nova-compute[74233]: INFO nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:26 user nova-compute[74233]: INFO nova.compute.manager [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Attaching volume 270ae127-3d80-482e-b715-96dedd6f0d2e to /dev/vdb
Oct 20 18:23:26 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Deleted allocations for instance bae683b9-94e9-4e4f-9621-93c2410d2351
Oct 20 18:23:26 user nova-compute[74233]: DEBUG os_brick.utils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:26 user nova-compute[74233]: INFO nova.compute.manager [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Took 41.41 seconds to build instance.
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bbb550-0509-4ce7-902a-c6f32f1dfa29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-35eb5b2b-f9cd-4b36-9e57-49e753b5f85d tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.525s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 32.844s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:26 user nova-compute[74233]: INFO nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e575046-8195-440c-b27a-598badb0db81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-927c3895-d67d-4245-98e9-2e5c6d4d714c tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "bae683b9-94e9-4e4f-9621-93c2410d2351" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.370s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[880eb5a3-d3f5-477a-9169-3e00f838fd27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8069e1f-9634-40de-ae85-713913010e38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:23:26 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:23:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1ece0c-e721-47c7-9ab5-bc7770c10994]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG os_brick.utils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:26 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Updating existing volume attachment record: b51efb82-15f7-4884-a576-20768af43025 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:23:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.volume.cinder [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Update attachment failed for attachment b51efb82-15f7-4884-a576-20768af43025. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b74f73a-a57b-4f6d-9ce7-4a208ba37b5e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b74f73a-a57b-4f6d-9ce7-4a208ba37b5e)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Failed to attach 270ae127-3d80-482e-b715-96dedd6f0d2e at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b74f73a-a57b-4f6d-9ce7-4a208ba37b5e)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Traceback (most recent call last):
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     self._do_attach(context, instance, volume, volume_api,
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     self._volume_attach(context, volume, connector, instance,
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     connection_info = volume_api.attachment_update(
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     res = method(self, ctx, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     with excutils.save_and_reraise_exception():
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     self.force_reraise()
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     raise self.value
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     return method.func(obj, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     resp = self._update('/attachments/%s' % id, body)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     return self.request(url, method, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05]     raise exceptions.from_response(resp, body)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b74f73a-a57b-4f6d-9ce7-4a208ba37b5e)
Oct 20 18:23:35 user nova-compute[74233]: ERROR nova.compute.manager [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] 
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.767s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-cd849725-76f2-45b4-9822-c337c04fc715 req-b446a95f-ab6a-450e-8e2b-31530c5e6c80 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event volume-reimaged-600c0d7b-697c-467c-8d7e-061bd4cb2509 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cd849725-76f2-45b4-9822-c337c04fc715 req-b446a95f-ab6a-450e-8e2b-31530c5e6c80 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cd849725-76f2-45b4-9822-c337c04fc715 req-b446a95f-ab6a-450e-8e2b-31530c5e6c80 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cd849725-76f2-45b4-9822-c337c04fc715 req-b446a95f-ab6a-450e-8e2b-31530c5e6c80 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-cd849725-76f2-45b4-9822-c337c04fc715 req-b446a95f-ab6a-450e-8e2b-31530c5e6c80 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Processing event volume-reimaged-600c0d7b-697c-467c-8d7e-061bd4cb2509 {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance event wait completed in 57 seconds for volume-reimaged {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server [None req-b273021a-3910-4917-a8d8-c59a4029e0e5 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b74f73a-a57b-4f6d-9ce7-4a208ba37b5e)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b74f73a-a57b-4f6d-9ce7-4a208ba37b5e)
Oct 20 18:23:35 user nova-compute[74233]: ERROR oslo_messaging.rpc.server 
Oct 20 18:23:35 user nova-compute[74233]: INFO nova.virt.block_device [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Booting with volume 600c0d7b-697c-467c-8d7e-061bd4cb2509 at /dev/vda
Oct 20 18:23:35 user nova-compute[74233]: DEBUG os_brick.utils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7929934d-1828-4a65-8efd-62caf2f04fbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c79e6-c90d-4bfe-821d-1dec2cf2c3af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a5bfd3-b152-4275-9181-96d838470cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f337177b-3c3e-4c69-b83e-5ae099c3d104]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:23:35 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:23:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33c38b9-4c61-4e2d-bd21-a6de15a4dd42]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG os_brick.utils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:35 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updating existing volume attachment record: e7911c72-2470-4c59-bab8-0a27f405c65f {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:23:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:23:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Creating image(s)
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Ensure instance console log exists: /opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Start _get_guest_xml network_info=[{"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'e7911c72-2470-4c59-bab8-0a27f405c65f', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'debfd120-e237-4afa-9b36-2bed99e48379', 'attached_at': '', 'detached_at': '', 'volume_id': '600c0d7b-697c-467c-8d7e-061bd4cb2509', 'serial': '600c0d7b-697c-467c-8d7e-061bd4cb2509'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:23:52 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 18:23:52 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lazy-loading 'vcpu_model' on Instance uuid debfd120-e237-4afa-9b36-2bed99e48379 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:52 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:52 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:23:52 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f8e466-9331-4f28-aefc-eaec2fa222b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:23:52 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1b75b2-1e5b-4cd8-aee2-5fb76d1af4a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509] added
Oct 20 18:23:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[765011fe-6ded-4fc5-babc-c74e4a0ddfca]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23cb681-4757-49ba-8184-1b6b460603f9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWNCtKLR {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWNCtKLR" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be936c7b-a5b0-49b9-8118-6000cae4c081]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWNCtKLR'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb67462-cea0-442c-8555-31a1e9f18fe7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45055725-3745-49cc-888d-e965e5217453]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03bd9d3-e61c-4a35-b408-4783ce0d7b10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]
Oct 20 18:23:52 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.
Oct 20 18:23:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79132a4a-5c34-43dc-95f3-4e99ada62312]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b09c6-6952-462f-95c6-bd3c50dd2b88]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:23:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc7357a-e4a3-41a8-89a0-5ff79400e494]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-changed-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Refreshing instance network info cache due to event network-changed-ede62683-5cec-4a67-93a3-e8a29411c4b0. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] Acquiring lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] Acquired lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Refreshing network info cache for port ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'flavor' on Instance uuid 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Ignoring supplied device name: /dev/vdb
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updated VIF entry in instance network info cache for port ede62683-5cec-4a67-93a3-e8a29411c4b0. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updating instance_info_cache with network_info: [{"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ae4a0f7b-c349-41b7-af96-fa2e49b304c2 req-5a7520ac-9abe-437b-8222-118fd2920eef service nova] Releasing lock "refresh_cache-0b81120b-9d1d-45e9-88c3-e9eaca49c210" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:53 user nova-compute[74233]: INFO nova.compute.manager [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Attaching volume 26a9d6c5-25af-46a6-a275-923d13622130 to /dev/vdb
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[818bc000-dfbd-4e0e-94bb-9537ef0d1aa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb96b9-885e-4756-aeff-1708678a6599]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5c3ecd-76c0-48b3-bedc-8523c4e5c1ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1ac36-a1d7-4003-a45a-f8d9d9c977b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:23:53 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:23:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f3d6e-9c1d-4f72-b997-97935d22b40f]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updating existing volume attachment record: c983181a-f23f-4098-8cd7-92b69f65796b {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23962346130373234', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962346130373234', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1762481964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382179192',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdxvKw/u2/yYNcSmoIIw3OhtKwd9N5pLEhMwvhcYInn0YmmQEqlhhtUrpuAHa9qB1NKrhaBPRWW5SC94JQy/O/YrBBmdOi7KhyHAC4xFBV4fmIstcf3tZGhxFTrqMLAA==',key_name='tempest-keypair-1819207714',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f91646be9384ebdab36bc6c813cb56e',ramdisk_id='',reservation_id='r-0l0w4hia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1458618408',owner_user_name='tempest-ServerActionsV293TestJSON-1458618408-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9207f9f82e346ec86d29521dc93e221',uuid=debfd120-e237-4afa-9b36-2bed99e48379,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converting VIF {"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:23:53 user nova-compute[74233]:   <uuid>debfd120-e237-4afa-9b36-2bed99e48379</uuid>
Oct 20 18:23:53 user nova-compute[74233]:   <name>instance-0000001d</name>
Oct 20 18:23:53 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:23:53 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:23:53 user nova-compute[74233]:   <metadata>
Oct 20 18:23:53 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:23:53 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:23:53 user nova-compute[74233]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1762481964</nova:name>
Oct 20 18:23:53 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:23:52</nova:creationTime>
Oct 20 18:23:53 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:23:53 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:23:53 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:23:53 user nova-compute[74233]:       <nova:owner>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:user uuid="b9207f9f82e346ec86d29521dc93e221">tempest-ServerActionsV293TestJSON-1458618408-project-member</nova:user>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:project uuid="1f91646be9384ebdab36bc6c813cb56e">tempest-ServerActionsV293TestJSON-1458618408</nova:project>
Oct 20 18:23:53 user nova-compute[74233]:       </nova:owner>
Oct 20 18:23:53 user nova-compute[74233]:       <nova:ports>
Oct 20 18:23:53 user nova-compute[74233]:         <nova:port uuid="de94c390-2e4c-4ea8-9456-e9f8b242a745">
Oct 20 18:23:53 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:23:53 user nova-compute[74233]:         </nova:port>
Oct 20 18:23:53 user nova-compute[74233]:       </nova:ports>
Oct 20 18:23:53 user nova-compute[74233]:     </nova:instance>
Oct 20 18:23:53 user nova-compute[74233]:   </metadata>
Oct 20 18:23:53 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:23:53 user nova-compute[74233]:     <system>
Oct 20 18:23:53 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:23:53 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:23:53 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:23:53 user nova-compute[74233]:       <entry name="serial">debfd120-e237-4afa-9b36-2bed99e48379</entry>
Oct 20 18:23:53 user nova-compute[74233]:       <entry name="uuid">debfd120-e237-4afa-9b36-2bed99e48379</entry>
Oct 20 18:23:53 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:23:53 user nova-compute[74233]:     </system>
Oct 20 18:23:53 user nova-compute[74233]:   </sysinfo>
Oct 20 18:23:53 user nova-compute[74233]:   <os>
Oct 20 18:23:53 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:23:53 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:23:53 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:23:53 user nova-compute[74233]:   </os>
Oct 20 18:23:53 user nova-compute[74233]:   <features>
Oct 20 18:23:53 user nova-compute[74233]:     <acpi/>
Oct 20 18:23:53 user nova-compute[74233]:     <apic/>
Oct 20 18:23:53 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:23:53 user nova-compute[74233]:   </features>
Oct 20 18:23:53 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:23:53 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:23:53 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:23:53 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:23:53 user nova-compute[74233]:   </clock>
Oct 20 18:23:53 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:23:53 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:23:53 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:23:53 user nova-compute[74233]:   </cpu>
Oct 20 18:23:53 user nova-compute[74233]:   <devices>
Oct 20 18:23:53 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:23:53 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:23:53 user nova-compute[74233]:       <source dev="/dev/sde"/>
Oct 20 18:23:53 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:23:53 user nova-compute[74233]:       <serial>600c0d7b-697c-467c-8d7e-061bd4cb2509</serial>
Oct 20 18:23:53 user nova-compute[74233]:     </disk>
Oct 20 18:23:53 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:23:53 user nova-compute[74233]:       <mac address="fa:16:3e:c7:a1:39"/>
Oct 20 18:23:53 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:53 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:23:53 user nova-compute[74233]:       <target dev="tapde94c390-2e"/>
Oct 20 18:23:53 user nova-compute[74233]:     </interface>
Oct 20 18:23:53 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:23:53 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379/console.log" append="off"/>
Oct 20 18:23:53 user nova-compute[74233]:     </serial>
Oct 20 18:23:53 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:23:53 user nova-compute[74233]:     <video>
Oct 20 18:23:53 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:23:53 user nova-compute[74233]:     </video>
Oct 20 18:23:53 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:23:53 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:23:53 user nova-compute[74233]:     </rng>
Oct 20 18:23:53 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:23:53 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:23:53 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:23:53 user nova-compute[74233]:     </memballoon>
Oct 20 18:23:53 user nova-compute[74233]:   </devices>
Oct 20 18:23:53 user nova-compute[74233]: </domain>
Oct 20 18:23:53 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1762481964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382179192',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdxvKw/u2/yYNcSmoIIw3OhtKwd9N5pLEhMwvhcYInn0YmmQEqlhhtUrpuAHa9qB1NKrhaBPRWW5SC94JQy/O/YrBBmdOi7KhyHAC4xFBV4fmIstcf3tZGhxFTrqMLAA==',key_name='tempest-keypair-1819207714',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f91646be9384ebdab36bc6c813cb56e',ramdisk_id='',reservation_id='r-0l0w4hia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1458618408',owner_user_name='tempest-ServerActionsV293TestJSON-1458618408-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9207f9f82e346ec86d29521dc93e221',uuid=debfd120-e237-4afa-9b36-2bed99e48379,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converting VIF {"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG os_vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac993ce2-a75f-5c84-af00-e743c37baec6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde94c390-2e, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde94c390-2e, col_values=(('qos', UUID('46480bd4-ac2c-4728-a5e0-b7a1f09ad197')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde94c390-2e, col_values=(('external_ids', {'iface-id': 'de94c390-2e4c-4ea8-9456-e9f8b242a745', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:a1:39', 'vm-uuid': 'debfd120-e237-4afa-9b36-2bed99e48379'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:23:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:54 user nova-compute[74233]: INFO os_vif [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e')
Oct 20 18:23:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:23:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] No VIF found with MAC fa:16:3e:c7:a1:39, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-1311017e-792a-475b-bb32-dc9ca9212d7d req-c417d2c7-03ca-4bea-b7c5-4e9909d5ee8a service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1311017e-792a-475b-bb32-dc9ca9212d7d req-c417d2c7-03ca-4bea-b7c5-4e9909d5ee8a service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1311017e-792a-475b-bb32-dc9ca9212d7d req-c417d2c7-03ca-4bea-b7c5-4e9909d5ee8a service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1311017e-792a-475b-bb32-dc9ca9212d7d req-c417d2c7-03ca-4bea-b7c5-4e9909d5ee8a service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-1311017e-792a-475b-bb32-dc9ca9212d7d req-c417d2c7-03ca-4bea-b7c5-4e9909d5ee8a service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:55 user nova-compute[74233]: WARNING nova.compute.manager [req-1311017e-792a-475b-bb32-dc9ca9212d7d req-c417d2c7-03ca-4bea-b7c5-4e9909d5ee8a service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:56 user nova-compute[74233]: INFO nova.compute.manager [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Terminating instance
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.compute.manager [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-359e67cd-c0f5-4fdf-a063-31f2d0e4fd66 req-4817f074-16f7-4b67-9bba-13ba62d49549 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-vif-unplugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-359e67cd-c0f5-4fdf-a063-31f2d0e4fd66 req-4817f074-16f7-4b67-9bba-13ba62d49549 service nova] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-359e67cd-c0f5-4fdf-a063-31f2d0e4fd66 req-4817f074-16f7-4b67-9bba-13ba62d49549 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-359e67cd-c0f5-4fdf-a063-31f2d0e4fd66 req-4817f074-16f7-4b67-9bba-13ba62d49549 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-359e67cd-c0f5-4fdf-a063-31f2d0e4fd66 req-4817f074-16f7-4b67-9bba-13ba62d49549 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] No waiting events found dispatching network-vif-unplugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-359e67cd-c0f5-4fdf-a063-31f2d0e4fd66 req-4817f074-16f7-4b67-9bba-13ba62d49549 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-vif-unplugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Instance destroyed successfully.
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.objects.instance [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'resources' on Instance uuid 7bdc323f-b8a2-4924-86bf-b35b1d680027 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1672533967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1672533967',id=20,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-cxzzw17q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:29Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=7bdc323f-b8a2-4924-86bf-b35b1d680027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "address": "fa:16:3e:87:d1:3b", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b22dfe5-9a", "ovs_interfaceid": "2b22dfe5-9a38-48a2-9436-59a232ee3bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG os_vif [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b22dfe5-9a, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac22e954-b8a5-4132-b7df-98e239c1278d) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:23:56 user nova-compute[74233]: INFO os_vif [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:d1:3b,bridge_name='br-int',has_traffic_filtering=True,id=2b22dfe5-9a38-48a2-9436-59a232ee3bad,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b22dfe5-9a')
Oct 20 18:23:56 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Deleting instance files /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027_del
Oct 20 18:23:56 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Deletion of /opt/stack/data/nova/instances/7bdc323f-b8a2-4924-86bf-b35b1d680027_del complete
Oct 20 18:23:56 user nova-compute[74233]: INFO nova.compute.manager [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 20 18:23:56 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:23:56 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:23:57 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Took 0.44 seconds to deallocate network for instance.
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:23:57 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance spawned successfully.
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-4d9479c6-85e8-42bd-9896-0502747fb82f req-cc218bbc-4a24-4c4d-a4e6-bee8069bb896 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4d9479c6-85e8-42bd-9896-0502747fb82f req-cc218bbc-4a24-4c4d-a4e6-bee8069bb896 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4d9479c6-85e8-42bd-9896-0502747fb82f req-cc218bbc-4a24-4c4d-a4e6-bee8069bb896 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4d9479c6-85e8-42bd-9896-0502747fb82f req-cc218bbc-4a24-4c4d-a4e6-bee8069bb896 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-4d9479c6-85e8-42bd-9896-0502747fb82f req-cc218bbc-4a24-4c4d-a4e6-bee8069bb896 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:57 user nova-compute[74233]: WARNING nova.compute.manager [req-4d9479c6-85e8-42bd-9896-0502747fb82f req-cc218bbc-4a24-4c4d-a4e6-bee8069bb896 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.021s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74233) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 18:23:57 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Deleted allocations for instance 7bdc323f-b8a2-4924-86bf-b35b1d680027
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cd849725-76f2-45b4-9822-c337c04fc715 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5d386174-7547-42a8-97a0-dd0e4b135ecc tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.775s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] Acquiring lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:23:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:23:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] Lock "7bdc323f-b8a2-4924-86bf-b35b1d680027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:23:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] No waiting events found dispatching network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:23:58 user nova-compute[74233]: WARNING nova.compute.manager [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received unexpected event network-vif-plugged-2b22dfe5-9a38-48a2-9436-59a232ee3bad for instance with vm_state deleted and task_state None.
Oct 20 18:23:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-794df76d-41d4-4380-908c-d022451dc78e req-4e6f1a22-e8ec-4515-8003-5842f4c7a792 service nova] [instance: 7bdc323f-b8a2-4924-86bf-b35b1d680027] Received event network-vif-deleted-2b22dfe5-9a38-48a2-9436-59a232ee3bad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:23:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:23:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:24:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:24:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-changed-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Refreshing instance network info cache due to event network-changed-10c936e6-7609-4bd3-9374-e18e5503c689. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] Acquiring lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] Acquired lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Refreshing network info cache for port 10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updated VIF entry in instance network info cache for port 10c936e6-7609-4bd3-9374-e18e5503c689. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG nova.network.neutron [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating instance_info_cache with network_info: [{"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'flavor' on Instance uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4363eb94-f8ce-4573-b746-10097815a22b req-83dfe88d-88ab-4d5e-986c-664e96a95760 service nova] Releasing lock "refresh_cache-aeb06e35-8797-4a76-a54b-f4d2dbb329d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:05 user nova-compute[74233]: INFO nova.compute.manager [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attaching volume fa89c49c-d30e-4c1a-9a6a-c725b598c62b to /dev/vdb
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG os_brick.utils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3821855-f7bb-467f-ac3a-7bff0750147f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10e74b6-a792-4620-8ebb-1356d0fe9fb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5c8cd-238e-49a5-82a7-e4046c2bc5a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d6ec99-cb02-45e4-902c-bd0de159782a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:05 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee2dce-5347-4f77-8fb6-6086a0fab68e]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG os_brick.utils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating existing volume attachment record: 9ccc8ded-56df-428e-a3c9-d030b6e2b013 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:06 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:24:06 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7067MB free_disk=24.894027709960938GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Applying migration context for instance 6d03ff84-b768-404f-a319-dde83c0d334f as it has an incoming, in-progress migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5. Migration status is finished {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 18:24:06 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating resource usage from migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 95824943-b9d7-4a42-ba57-56ff4aad7142 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance debfd120-e237-4afa-9b36-2bed99e48379 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5b5e15d0-98d8-4f35-98ff-41e922792b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a733ecd9-bafe-4cdd-84ce-b1ae4791b7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:24:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:24:07 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:24:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:24:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:24:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:24:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:24:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:24:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIoucXLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:11 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ebb69f-0314-4fbc-9fd7-4ec276764070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:24:11 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4104105f-0937-4b4d-9f20-9d6bc9775b11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130] added
Oct 20 18:24:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f40e88-4e3c-45b7-8d11-1245637186b2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5197d132-9d33-444c-847a-a62fd8918088]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIoucXLG {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIoucXLG" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75178663-1e9c-40f8-b92b-b7ba49d0daa0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIoucXLG'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf725c-f011-44be-a484-5b6f71e1802d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9566a-fbdf-4d68-baf7-6224774337a4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d898501-e8eb-4ae4-bf32-bbde1b4b51b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260]
Oct 20 18:24:12 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260] successful.
Oct 20 18:24:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e87e7-22d2-4b4e-883a-37dcc40182b5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[185aaf23-e77f-463b-a0e1-0ebfbf0c9d9d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d6a426-3c44-4f50-af8e-147a7e97deaa]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIoucXLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26331393530313235', 'path': '/dev/sdf'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331393530313235', 'path': '/dev/sdf'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'flavor' on Instance uuid 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:24:13 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:24:13 user nova-compute[74233]:   <source dev="/dev/sdf"/>
Oct 20 18:24:13 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:24:13 user nova-compute[74233]:   <serial>26a9d6c5-25af-46a6-a275-923d13622130</serial>
Oct 20 18:24:13 user nova-compute[74233]: </disk>
Oct 20 18:24:13 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-changed-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Refreshing instance network info cache due to event network-changed-d02fb71a-88f4-47ad-9ac4-3e2609efaeac. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] Acquiring lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] Acquired lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.network.neutron [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Refreshing network info cache for port d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No VIF found with MAC fa:16:3e:df:75:a0, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9a3fe75f-f509-4dd4-b6f0-4c5f265d4445 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.005s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.network.neutron [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updated VIF entry in instance network info cache for port d02fb71a-88f4-47ad-9ac4-3e2609efaeac. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG nova.network.neutron [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating instance_info_cache with network_info: [{"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-cdf2db4f-4281-4759-bcb4-70e1dcc650b5 req-517f780e-82b0-4b3a-918f-f91bdecef117 service nova] Releasing lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:20 user nova-compute[74233]: INFO nova.compute.manager [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attaching volume 3c10d089-eddf-4b2f-a894-90aaa74b5e73 to /dev/vdb
Oct 20 18:24:20 user nova-compute[74233]: DEBUG os_brick.utils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9a9c2-ddd5-484d-adf0-a3052bc00ddf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8505d7e-9303-429c-bcb3-099f312d6483]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3fb664-322d-417a-8bd2-62756c0b157c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564d91d-0ebd-45e8-be20-f2cd81d12aab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:20 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:24:20 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc264f97-4a2f-4236-9446-dde79737a40b]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG os_brick.utils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:20 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating existing volume attachment record: 7cba6345-e909-4eba-b8a7-65eec214c740 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:24:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:24 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:24 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:24 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf57d56-b123-48cd-a84d-9cece857a933]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:24:24 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[51623d93-78a0-4054-91ff-a4989ab0297d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b] added
Oct 20 18:24:24 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88e229-c684-49d7-b75a-806e0f44f26b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fb4b3-55c4-4b8d-bd83-1e73641657bb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZpOvAqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZpOvAqn" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[903f4de8-72fe-43bc-9c36-d09444db9c17]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JZpOvAqn'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be55ed5-5b5d-47ce-8320-5e198f0dbc5a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81610cf6-8fef-4458-86aa-f8f8a4d1fd9b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb310b7-7c0e-4b6b-97a6-71c57712e93b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]
Oct 20 18:24:24 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.
Oct 20 18:24:24 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88beec-cc88-4e2f-a905-9a60268409e5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f8a9d-71ae-4f04-b8f0-7fbf4d7f3e54]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:24:24 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:24 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b66a7-e5d5-487d-bc12-2ff2165a056b]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:24:24 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:24:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26538396636373038', 'path': '/dev/sdg'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538396636373038', 'path': '/dev/sdg'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:24:25 user nova-compute[74233]: DEBUG nova.objects.instance [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'flavor' on Instance uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:24:25 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:24:25 user nova-compute[74233]:   <source dev="/dev/sdg"/>
Oct 20 18:24:25 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:24:25 user nova-compute[74233]:   <serial>fa89c49c-d30e-4c1a-9a6a-c725b598c62b</serial>
Oct 20 18:24:25 user nova-compute[74233]: </disk>
Oct 20 18:24:25 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:24:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:24:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:24:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No VIF found with MAC fa:16:3e:1d:b1:ef, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:24:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-1e55dbfc-13aa-43d7-9284-1827e497312c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.264s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:27 user nova-compute[74233]: INFO nova.compute.manager [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Rebuilding instance
Oct 20 18:24:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-abdc539f-7ea4-46a3-9e2b-ad7bdede7546 req-ab9c384e-505b-4425-8340-dfc78c753a28 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-abdc539f-7ea4-46a3-9e2b-ad7bdede7546 req-ab9c384e-505b-4425-8340-dfc78c753a28 service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-abdc539f-7ea4-46a3-9e2b-ad7bdede7546 req-ab9c384e-505b-4425-8340-dfc78c753a28 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-abdc539f-7ea4-46a3-9e2b-ad7bdede7546 req-ab9c384e-505b-4425-8340-dfc78c753a28 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-abdc539f-7ea4-46a3-9e2b-ad7bdede7546 req-ab9c384e-505b-4425-8340-dfc78c753a28 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:24:28 user nova-compute[74233]: WARNING nova.compute.manager [req-abdc539f-7ea4-46a3-9e2b-ad7bdede7546 req-ab9c384e-505b-4425-8340-dfc78c753a28 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state active and task_state rebuilding.
Oct 20 18:24:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance destroyed successfully.
Oct 20 18:24:28 user nova-compute[74233]: INFO nova.compute.manager [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Detaching volume fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:24:29 user nova-compute[74233]: INFO nova.virt.block_device [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attempting to driver detach volume fa89c49c-d30e-4c1a-9a6a-c725b598c62b from mountpoint /dev/vdb
Oct 20 18:24:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Attempting to detach device vdb from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:24:29 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:24:29 user nova-compute[74233]:   <source dev="/dev/sdg"/>
Oct 20 18:24:29 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:24:29 user nova-compute[74233]:   <serial>fa89c49c-d30e-4c1a-9a6a-c725b598c62b</serial>
Oct 20 18:24:29 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:24:29 user nova-compute[74233]: </disk>
Oct 20 18:24:29 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:24:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully detached device vdb from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 from the persistent domain config.
Oct 20 18:24:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:29 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bd93bc-2385-4187-9a02-215346e8a3bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:24:29 user nova-compute[74233]: No targets found.
Oct 20 18:24:29 user nova-compute[74233]: iSNS:
Oct 20 18:24:29 user nova-compute[74233]: No targets found.
Oct 20 18:24:29 user nova-compute[74233]: STATIC:
Oct 20 18:24:29 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:24:29 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:29 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:29 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:24:29 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:29 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:29 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:24:29 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:29 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:29 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:24:29 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:29 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:29 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:24:29 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:29 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:29 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:24:29 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:29 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:29 user nova-compute[74233]: FIRMWARE:
Oct 20 18:24:29 user nova-compute[74233]: No targets found.
Oct 20 18:24:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:24:29 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:24:29 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20db21da-5130-4dcd-9ebf-a364ad075eb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3686a-9327-4bec-9017-d6f59b70cb57]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:24:29 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b'): ({'sdg'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Removing single pathed devices sdg {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[208d4b55-b926-491d-b91f-81ba0af03022]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89eac92-83ce-48ef-a0c1-e9a02f75705b]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flushing IO for device /dev/sdg {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20373492-9694-401d-96d7-9c2945e0f9e4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bff0eb-8590-4e12-8c26-6499dae6c0f5]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0293c033-4faf-40be-a14f-4c62a7f8afb9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14acb846-4b90-4bcc-90bc-e5cd34f7d106]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]
Oct 20 18:24:29 user nova-compute[74233]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.
Oct 20 18:24:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135a5e6-c8c5-42ae-8480-b2bcfe9de597]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== disconnect_volume: return (338ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:24:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ef01262-1723-4b21-bfa1-db2863b2f6f2 req-2c9c9e68-2244-415f-a294-e9e2a5d4cedf service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ef01262-1723-4b21-bfa1-db2863b2f6f2 req-2c9c9e68-2244-415f-a294-e9e2a5d4cedf service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ef01262-1723-4b21-bfa1-db2863b2f6f2 req-2c9c9e68-2244-415f-a294-e9e2a5d4cedf service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7ef01262-1723-4b21-bfa1-db2863b2f6f2 req-2c9c9e68-2244-415f-a294-e9e2a5d4cedf service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-7ef01262-1723-4b21-bfa1-db2863b2f6f2 req-2c9c9e68-2244-415f-a294-e9e2a5d4cedf service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:24:30 user nova-compute[74233]: WARNING nova.compute.manager [req-7ef01262-1723-4b21-bfa1-db2863b2f6f2 req-2c9c9e68-2244-415f-a294-e9e2a5d4cedf service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state active and task_state rebuilding.
Oct 20 18:24:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance destroyed successfully.
Oct 20 18:24:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-13211816',display_name='tempest-ServerActionsTestOtherA-server-1359886685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-13211816',id=32,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDkG3eixSC9gYo6kNgsId3y7xJBVqfNTJcfeDkXB4fKSG6GYa7Hxh97vm3lDnEBW3Dhhhctco6EJLFmoisxDflzxlnK3Z6N6U7kZND6xrKsWC9Kbr/+pjFjQ0QfP6rlvw==',key_name='tempest-keypair-142935039',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:22:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-mhezx8yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:24:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=aeb06e35-8797-4a76-a54b-f4d2dbb329d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10c936e6-76, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab25fb6d-3a5b-4dca-b83a-c79701121ca1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:33 user nova-compute[74233]: INFO os_vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76')
Oct 20 18:24:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[622935ad-48d9-4091-be08-2e0968f67a07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:24:33 user nova-compute[74233]: No targets found.
Oct 20 18:24:33 user nova-compute[74233]: iSNS:
Oct 20 18:24:33 user nova-compute[74233]: No targets found.
Oct 20 18:24:33 user nova-compute[74233]: STATIC:
Oct 20 18:24:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:24:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:24:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:24:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:24:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:33 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:24:33 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:33 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:33 user nova-compute[74233]: FIRMWARE:
Oct 20 18:24:33 user nova-compute[74233]: No targets found.
Oct 20 18:24:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:24:33 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:24:33 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bee5b44-217b-45b0-987e-a66c3fb058c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3072230-bab6-44d5-a014-835742dc61f9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e9360>, {}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Disconnecting from: [] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== disconnect_volume: return (79ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:24:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Deleting instance files /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3_del
Oct 20 18:24:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Deletion of /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3_del complete
Oct 20 18:24:34 user nova-compute[74233]: INFO nova.virt.block_device [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Booting with volume fa89c49c-d30e-4c1a-9a6a-c725b598c62b at /dev/vdb
Oct 20 18:24:34 user nova-compute[74233]: DEBUG os_brick.utils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab631bee-56f8-42b7-8f57-8bb215d7d9fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa96e1e-9d52-4cfd-ab53-19049eb2347c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba610fe-fc1c-4a0c-8cc5-ee0043789d78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0ee29-143c-4249-a5dd-533c832566d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:34 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:24:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ff2d3-e8c2-47a0-8cc9-02824414d556]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG os_brick.utils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:34 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating existing volume attachment record: 8e412492-405e-41b7-ab39-a5c2102fd0e6 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:24:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-changed-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Refreshing instance network info cache due to event network-changed-56807116-38ed-4b60-9867-b9964dcbb67d. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:24:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] Acquiring lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] Acquired lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:36 user nova-compute[74233]: DEBUG nova.network.neutron [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Refreshing network info cache for port 56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:24:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updated VIF entry in instance network info cache for port 56807116-38ed-4b60-9867-b9964dcbb67d. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:24:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updating instance_info_cache with network_info: [{"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-88ff0f5e-5cfa-4a0d-9cb6-1c39f14628f6 req-705d37c9-262a-4f05-934e-a6b5ee32d525 service nova] Releasing lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIpUCyxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:39 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:39 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:39 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022ded5-0db9-4292-a834-890d7b502872]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:24:39 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedb593a-f58e-426e-a0f3-29e5bf3f916d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73] added
Oct 20 18:24:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41631122-e562-4cb4-8b62-e33623035ab9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b02034-4ad0-4a2e-a0b0-f0efd72c8703]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIpUCyxk {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIpUCyxk" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbe563-5fcc-4dbf-8ade-d88591063bb1]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GIpUCyxk'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42282fa-03d2-4c99-8b66-c8a052c1a6ad]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a828925-02e7-46b4-8efd-53e022fa1c15]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f517f06e-1d82-48ce-a472-39fbceab547f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260]
Oct 20 18:24:39 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260] successful.
Oct 20 18:24:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec18eac-7189-42e6-9d1e-1fbca3983553]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e7a50-8c1d-43fa-ae88-fd5ad8a3a758]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:39 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac6e67d-1556-449f-857d-8ab4c89a3b06]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIpUCyxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Port 6b4ef092-a79c-40e6-98a2-e6a45f6044c3 binding to destination host user is already ACTIVE {{(pid=74233) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Creating tmpfile /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/tmpfpi8z_1h to verify with other compute node that the instance is on the same shared storage. {{(pid=74233) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-8a136e62-0ea6-4159-8c38-d8ff7eab47d2 req-fd126dbf-9b14-4386-9c4c-d5b619f0f09f service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a136e62-0ea6-4159-8c38-d8ff7eab47d2 req-fd126dbf-9b14-4386-9c4c-d5b619f0f09f service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a136e62-0ea6-4159-8c38-d8ff7eab47d2 req-fd126dbf-9b14-4386-9c4c-d5b619f0f09f service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8a136e62-0ea6-4159-8c38-d8ff7eab47d2 req-fd126dbf-9b14-4386-9c4c-d5b619f0f09f service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-8a136e62-0ea6-4159-8c38-d8ff7eab47d2 req-fd126dbf-9b14-4386-9c4c-d5b619f0f09f service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:24:40 user nova-compute[74233]: WARNING nova.compute.manager [req-8a136e62-0ea6-4159-8c38-d8ff7eab47d2 req-fd126dbf-9b14-4386-9c4c-d5b619f0f09f service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state resized and task_state resize_reverting.
Oct 20 18:24:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23963303965336266', 'path': '/dev/sdg'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963303965336266', 'path': '/dev/sdg'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:24:40 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:24:40 user nova-compute[74233]:   <source dev="/dev/sdg"/>
Oct 20 18:24:40 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:24:40 user nova-compute[74233]:   <serial>3c10d089-eddf-4b2f-a894-90aaa74b5e73</serial>
Oct 20 18:24:40 user nova-compute[74233]: </disk>
Oct 20 18:24:40 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:24:41 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance destroyed successfully.
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'resources' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b4ef092-a7, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b22a52d4-a472-468b-b297-159d13cafa93) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:41 user nova-compute[74233]: INFO os_vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7')
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:41 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[393213a2-092b-4f95-aa64-5ad219459145]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:24:41 user nova-compute[74233]: No targets found.
Oct 20 18:24:41 user nova-compute[74233]: iSNS:
Oct 20 18:24:41 user nova-compute[74233]: No targets found.
Oct 20 18:24:41 user nova-compute[74233]: STATIC:
Oct 20 18:24:41 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:24:41 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:41 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:41 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:24:41 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:41 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:41 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:24:41 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:41 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:41 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:24:41 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:41 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:41 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:24:41 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:41 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:41 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:24:41 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:41 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:41 user nova-compute[74233]: FIRMWARE:
Oct 20 18:24:41 user nova-compute[74233]: No targets found.
Oct 20 18:24:41 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:24:41 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:24:41 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No VIF found with MAC fa:16:3e:74:9a:63, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be2b22-f19e-4eba-90d4-33b7389ecbb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[159bca31-e5e9-420c-a0bb-e7d0dabb46f4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:41 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9506cbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d0ec5-d829-44bd-8298-e9c4d85c92f4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9eb7fc-eeb1-4db1-81f4-1af663155161]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d374d-f8dd-40bb-83b8-5e71a0b4db26]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b75ee3ce-5a82-4eda-80f0-04567c5d6c8e tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.060s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a76eb-9611-47a0-9f41-a4b53a09baff]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf4800-46c9-4e74-9cd4-1f76b57e87a6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaafcdf-88f0-4aac-88ea-a56772b2ac98]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]
Oct 20 18:24:41 user nova-compute[74233]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.
Oct 20 18:24:41 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad33106-5a5b-49a3-9e99-1ad01ce2915d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== disconnect_volume: return (349ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-60adcf0d-c0e3-4e96-9c6a-65eb780c5db3 req-fee502a1-b6f1-45ec-ab0c-196d41ff2e2e service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-60adcf0d-c0e3-4e96-9c6a-65eb780c5db3 req-fee502a1-b6f1-45ec-ab0c-196d41ff2e2e service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-60adcf0d-c0e3-4e96-9c6a-65eb780c5db3 req-fee502a1-b6f1-45ec-ab0c-196d41ff2e2e service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-60adcf0d-c0e3-4e96-9c6a-65eb780c5db3 req-fee502a1-b6f1-45ec-ab0c-196d41ff2e2e service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-60adcf0d-c0e3-4e96-9c6a-65eb780c5db3 req-fee502a1-b6f1-45ec-ab0c-196d41ff2e2e service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:24:42 user nova-compute[74233]: WARNING nova.compute.manager [req-60adcf0d-c0e3-4e96-9c6a-65eb780c5db3 req-fee502a1-b6f1-45ec-ab0c-196d41ff2e2e service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state resized and task_state resize_reverting.
Oct 20 18:24:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'migration_context' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:42 user nova-compute[74233]: DEBUG nova.objects.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Object Instance<6d03ff84-b768-404f-a319-dde83c0d334f> lazy-loaded attributes: resources,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:24:43 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:24:43 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:24:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.561s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:43 user nova-compute[74233]: INFO nova.compute.manager [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Swapping old allocation on dict_keys(['cc4059c5-9fe5-4cfa-b006-c468906869b2']) held by migration 4692b1c5-7784-4106-b5f4-8e4634e1a2f5 for instance
Oct 20 18:24:43 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Overwriting current allocation {'allocations': {'cc4059c5-9fe5-4cfa-b006-c468906869b2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 39}}, 'project_id': 'c98418bca8ed4de094d230072e355984', 'user_id': '5560a7c568e54a76b94eb889229c78a5', 'consumer_generation': 1} on consumer 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 18:24:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquired lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:43 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG nova.network.neutron [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Releasing lock "refresh_cache-6d03ff84-b768-404f-a319-dde83c0d334f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG os_brick.utils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a86ea-bfde-4e05-9e3a-983169ce3aeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc64ec-1520-4ddc-9d7f-dc8e195ad64c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ac594-61b5-4b24-a2c3-b27b0890ca69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0875f2e-2d62-4bdb-8914-3bf707a1f12f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:44 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:24:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd75394c-c45d-4c20-b578-553ae346cf58]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:24:44 user nova-compute[74233]: DEBUG os_brick.utils [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:46 user nova-compute[74233]: INFO nova.compute.manager [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Terminating instance
Oct 20 18:24:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-c61897dd-f566-445b-9e38-50c89b5630cb req-62cbcf46-2a28-4872-b8ab-5b0f73fd1277 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c61897dd-f566-445b-9e38-50c89b5630cb req-62cbcf46-2a28-4872-b8ab-5b0f73fd1277 service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c61897dd-f566-445b-9e38-50c89b5630cb req-62cbcf46-2a28-4872-b8ab-5b0f73fd1277 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c61897dd-f566-445b-9e38-50c89b5630cb req-62cbcf46-2a28-4872-b8ab-5b0f73fd1277 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-c61897dd-f566-445b-9e38-50c89b5630cb req-62cbcf46-2a28-4872-b8ab-5b0f73fd1277 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-c61897dd-f566-445b-9e38-50c89b5630cb req-62cbcf46-2a28-4872-b8ab-5b0f73fd1277 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-unplugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Instance destroyed successfully.
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.objects.instance [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'resources' on Instance uuid 95824943-b9d7-4a42-ba57-56ff4aad7142 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114649267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114649267',id=11,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-erxct8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:12:46Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=95824943-b9d7-4a42-ba57-56ff4aad7142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "e7731480-1384-4cdd-93e3-f63ae477d471", "address": "fa:16:3e:7d:76:a1", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7731480-13", "ovs_interfaceid": "e7731480-1384-4cdd-93e3-f63ae477d471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_vif [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7731480-13, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75f6af90-5a69-46ad-b066-ce2beee8c7a7) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:24:47 user nova-compute[74233]: INFO os_vif [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:76:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7731480-1384-4cdd-93e3-f63ae477d471,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7731480-13')
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDxINpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:47 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d67ab1-d080-4c94-995a-e778fd5ecf40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:24:47 user nova-compute[74233]: No targets found.
Oct 20 18:24:47 user nova-compute[74233]: iSNS:
Oct 20 18:24:47 user nova-compute[74233]: No targets found.
Oct 20 18:24:47 user nova-compute[74233]: STATIC:
Oct 20 18:24:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:24:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:24:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:24:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:24:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:47 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3
Oct 20 18:24:47 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:24:47 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:24:47 user nova-compute[74233]: FIRMWARE:
Oct 20 18:24:47 user nova-compute[74233]: No targets found.
Oct 20 18:24:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:24:47 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:24:47 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c85ac-a26d-4e57-9caa-1ae698b983c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed511bda-f28c-4c4b-9899-261bf3e9215d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 (non-flash)
Oct 20 18:24:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950672170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4c4a1-1134-427e-ba17-0a22aa0829e6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[281581c0-3171-496e-ae39-ef0929ad0e94]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb47a0-3435-405c-9d4e-5f531043ea22]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97af0f78-a566-4e0f-b964-18c30a672ed5]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37d9755-0167-40c3-a077-f1d1fc38c352]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2393ba-1422-48a5-86d6-27f16d40d351]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260]
Oct 20 18:24:47 user nova-compute[74233]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3, portal: 172.16.0.220,3260] successful.
Oct 20 18:24:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7995a08-6018-45ef-89cd-d30bcfb34fb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb16bb6-a3b7-44a2-8254-31526992b03f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] <== disconnect_volume: return (352ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:24:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Deleting instance files /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142_del
Oct 20 18:24:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Deletion of /opt/stack/data/nova/instances/95824943-b9d7-4a42-ba57-56ff4aad7142_del complete
Oct 20 18:24:47 user nova-compute[74233]: INFO nova.compute.manager [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 20 18:24:47 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:24:47 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:24:48 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:48 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Took 0.42 seconds to deallocate network for instance.
Oct 20 18:24:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9774b21-6902-486a-bc85-8779f45ca8f1 req-a6687498-ee34-4228-af1d-d1209ddb86e0 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-deleted-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-0e573079-8652-40a9-83d0-b6560fe7b13c req-d88ca27f-7c9f-4076-b16d-38ba795f17c2 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0e573079-8652-40a9-83d0-b6560fe7b13c req-d88ca27f-7c9f-4076-b16d-38ba795f17c2 service nova] Acquiring lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0e573079-8652-40a9-83d0-b6560fe7b13c req-d88ca27f-7c9f-4076-b16d-38ba795f17c2 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0e573079-8652-40a9-83d0-b6560fe7b13c req-d88ca27f-7c9f-4076-b16d-38ba795f17c2 service nova] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-0e573079-8652-40a9-83d0-b6560fe7b13c req-d88ca27f-7c9f-4076-b16d-38ba795f17c2 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] No waiting events found dispatching network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:24:48 user nova-compute[74233]: WARNING nova.compute.manager [req-0e573079-8652-40a9-83d0-b6560fe7b13c req-d88ca27f-7c9f-4076-b16d-38ba795f17c2 service nova] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Received unexpected event network-vif-plugged-e7731480-1384-4cdd-93e3-f63ae477d471 for instance with vm_state active and task_state deleting.
Oct 20 18:24:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:53 user nova-compute[74233]: INFO nova.compute.manager [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 95824943-b9d7-4a42-ba57-56ff4aad7142] Took 4.76 seconds to detach 1 volumes for instance.
Oct 20 18:24:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:53 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:24:53 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:24:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:53 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Deleted allocations for instance 95824943-b9d7-4a42-ba57-56ff4aad7142
Oct 20 18:24:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-646b0e24-4cf4-43eb-8d8e-66b61b6670cd tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "95824943-b9d7-4a42-ba57-56ff4aad7142" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.094s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:24:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:24:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:24:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:24:54 user nova-compute[74233]: INFO nova.compute.claims [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Claim successful on node user
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:24:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.policy [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10447188fbd74b18ba64fc8e64d267c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b592b103d8084815bf6d3132c1215feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:24:55 user nova-compute[74233]: INFO nova.virt.block_device [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Booting with volume e1099585-12f0-4d21-83d3-b314017fd66c at /dev/vda
Oct 20 18:24:55 user nova-compute[74233]: DEBUG os_brick.utils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba0625e-dd2d-4f8f-8429-387a3fb8d110]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4905d61f-da55-4c56-889b-49c7d71e9fb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4861d96f-803a-4cea-9efe-155b05421de5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[664fb51f-77ee-4521-85cf-c3412e166d3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:24:55 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:24:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbe2d9-c237-4f0c-9abf-6f817f2612f8]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG os_brick.utils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updating existing volume attachment record: 7518a63a-0cf1-415a-99bd-fbd9593c80f4 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Successfully created port: 87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Successfully updated port: 87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquired lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-changed-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Refreshing instance network info cache due to event network-changed-87fd02ce-7cca-416a-a82b-58ae33042cef. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] Acquiring lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updating instance_info_cache with network_info: [{"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Releasing lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Instance network_info: |[{"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] Acquired lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:24:56 user nova-compute[74233]: DEBUG nova.network.neutron [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Refreshing network info cache for port 87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:24:57 user nova-compute[74233]: DEBUG nova.network.neutron [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updated VIF entry in instance network info cache for port 87fd02ce-7cca-416a-a82b-58ae33042cef. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:24:57 user nova-compute[74233]: DEBUG nova.network.neutron [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updating instance_info_cache with network_info: [{"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:24:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b76e52-3202-496d-8fce-581f59e2d077 req-05a04769-dc66-4ed1-b093-001ec284c4f0 service nova] Releasing lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:24:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:24:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Starting finish_revert_migration {{(pid=74233) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start _get_guest_xml network_info=[{"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '12c93602-ed08-46e0-8ada-095fc771346d', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6d03ff84-b768-404f-a319-dde83c0d334f', 'attached_at': '2023-10-20T18:25:03.000000', 'detached_at': '', 'volume_id': '0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'serial': '0489f953-4e2a-46cc-8a04-b8ffe75a5668'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:25:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:03 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:03 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:03 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83934a-a03c-4356-ae6b-7d8552e7cdc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:25:03 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e755b27a-4492-422d-93e1-563368b9cd01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668] added
Oct 20 18:25:03 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1cdf79-274c-4650-85a1-b5da793a2560]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ea9134-d986-453d-897c-97869b91fed5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmEGTip {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmEGTip" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75d6fe5-bcd5-4c69-a86b-1c39c69a42fc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFmEGTip'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa1558a-8ef6-4b14-9758-778a5bd3cbde]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef11c4-b454-4949-9b82-fade7b81b9ed]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dedff2-54ca-4c0c-bb17-a9f80e940a47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]
Oct 20 18:25:03 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.
Oct 20 18:25:03 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755edb5-edd6-4a42-bf86-e0bd52b80b59]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49931d-4531-414d-987f-c3387287c643]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:03 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b0159-c226-45a0-9dc2-dc5e859859ec]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:25:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23663366533333333', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663366533333333', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:25:04 user nova-compute[74233]:   <uuid>6d03ff84-b768-404f-a319-dde83c0d334f</uuid>
Oct 20 18:25:04 user nova-compute[74233]:   <name>instance-0000001b</name>
Oct 20 18:25:04 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:25:04 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:25:04 user nova-compute[74233]:   <metadata>
Oct 20 18:25:04 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:25:04 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:25:04 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherB-server-906554630</nova:name>
Oct 20 18:25:04 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:25:03</nova:creationTime>
Oct 20 18:25:04 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:25:04 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:25:04 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:25:04 user nova-compute[74233]:       <nova:owner>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:user uuid="5560a7c568e54a76b94eb889229c78a5">tempest-ServerActionsTestOtherB-2120896258-project-member</nova:user>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:project uuid="c98418bca8ed4de094d230072e355984">tempest-ServerActionsTestOtherB-2120896258</nova:project>
Oct 20 18:25:04 user nova-compute[74233]:       </nova:owner>
Oct 20 18:25:04 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:25:04 user nova-compute[74233]:       <nova:ports>
Oct 20 18:25:04 user nova-compute[74233]:         <nova:port uuid="6b4ef092-a79c-40e6-98a2-e6a45f6044c3">
Oct 20 18:25:04 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 18:25:04 user nova-compute[74233]:         </nova:port>
Oct 20 18:25:04 user nova-compute[74233]:       </nova:ports>
Oct 20 18:25:04 user nova-compute[74233]:     </nova:instance>
Oct 20 18:25:04 user nova-compute[74233]:   </metadata>
Oct 20 18:25:04 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:25:04 user nova-compute[74233]:     <system>
Oct 20 18:25:04 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:25:04 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:25:04 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:25:04 user nova-compute[74233]:       <entry name="serial">6d03ff84-b768-404f-a319-dde83c0d334f</entry>
Oct 20 18:25:04 user nova-compute[74233]:       <entry name="uuid">6d03ff84-b768-404f-a319-dde83c0d334f</entry>
Oct 20 18:25:04 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:25:04 user nova-compute[74233]:     </system>
Oct 20 18:25:04 user nova-compute[74233]:   </sysinfo>
Oct 20 18:25:04 user nova-compute[74233]:   <os>
Oct 20 18:25:04 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:25:04 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:25:04 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:25:04 user nova-compute[74233]:   </os>
Oct 20 18:25:04 user nova-compute[74233]:   <features>
Oct 20 18:25:04 user nova-compute[74233]:     <acpi/>
Oct 20 18:25:04 user nova-compute[74233]:     <apic/>
Oct 20 18:25:04 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:25:04 user nova-compute[74233]:   </features>
Oct 20 18:25:04 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:25:04 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:25:04 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:25:04 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:25:04 user nova-compute[74233]:   </clock>
Oct 20 18:25:04 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:25:04 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:25:04 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:25:04 user nova-compute[74233]:   </cpu>
Oct 20 18:25:04 user nova-compute[74233]:   <devices>
Oct 20 18:25:04 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:25:04 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:25:04 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk"/>
Oct 20 18:25:04 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:25:04 user nova-compute[74233]:     </disk>
Oct 20 18:25:04 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:25:04 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:04 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:25:04 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:25:04 user nova-compute[74233]:       <serial>0489f953-4e2a-46cc-8a04-b8ffe75a5668</serial>
Oct 20 18:25:04 user nova-compute[74233]:     </disk>
Oct 20 18:25:04 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:25:04 user nova-compute[74233]:       <mac address="fa:16:3e:8f:cb:6c"/>
Oct 20 18:25:04 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:04 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:25:04 user nova-compute[74233]:       <target dev="tap6b4ef092-a7"/>
Oct 20 18:25:04 user nova-compute[74233]:     </interface>
Oct 20 18:25:04 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:25:04 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/console.log" append="off"/>
Oct 20 18:25:04 user nova-compute[74233]:     </serial>
Oct 20 18:25:04 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:25:04 user nova-compute[74233]:     <video>
Oct 20 18:25:04 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:04 user nova-compute[74233]:     </video>
Oct 20 18:25:04 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:25:04 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:25:04 user nova-compute[74233]:     </rng>
Oct 20 18:25:04 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:25:04 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:25:04 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:25:04 user nova-compute[74233]:     </memballoon>
Oct 20 18:25:04 user nova-compute[74233]:   </devices>
Oct 20 18:25:04 user nova-compute[74233]: </domain>
Oct 20 18:25:04 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG os_vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a36e68a7-177f-5434-ae2c-b1f7390ca3f0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b4ef092-a7, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b4ef092-a7, col_values=(('qos', UUID('d483b93a-adf4-4597-9312-2aa511f7e72e')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b4ef092-a7, col_values=(('external_ids', {'iface-id': '6b4ef092-a79c-40e6-98a2-e6a45f6044c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:cb:6c', 'vm-uuid': '6d03ff84-b768-404f-a319-dde83c0d334f'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:04 user nova-compute[74233]: INFO os_vif [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7')
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing instance network info cache due to event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'flavor' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.172s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-6b4ee4ab-fdd1-4251-92d1-d1ba58e02641 req-33305c33-ad35-40f9-b942-e1773bac5c1c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b4ee4ab-fdd1-4251-92d1-d1ba58e02641 req-33305c33-ad35-40f9-b942-e1773bac5c1c service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b4ee4ab-fdd1-4251-92d1-d1ba58e02641 req-33305c33-ad35-40f9-b942-e1773bac5c1c service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6b4ee4ab-fdd1-4251-92d1-d1ba58e02641 req-33305c33-ad35-40f9-b942-e1773bac5c1c service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-6b4ee4ab-fdd1-4251-92d1-d1ba58e02641 req-33305c33-ad35-40f9-b942-e1773bac5c1c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:06 user nova-compute[74233]: WARNING nova.compute.manager [req-6b4ee4ab-fdd1-4251-92d1-d1ba58e02641 req-33305c33-ad35-40f9-b942-e1773bac5c1c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state resized and task_state resize_reverting.
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updated VIF entry in instance network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG nova.network.neutron [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:06 user nova-compute[74233]: INFO nova.compute.manager [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Attaching volume 4ef4a842-4d4f-4db3-bb79-0ac8390d25aa to /dev/vdb
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-11a60c19-a3ff-4cb4-b513-83d069fef24b req-1e58e617-e00b-4cb0-9142-0e04d2f688d9 service nova] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG os_brick.utils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc653f2-caab-4f6f-81fb-94765cae267f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc5cd3-20d9-45ec-b0dc-7f958ef748da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[656c83c2-3578-4f95-abad-c27e0538de3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc63403-c971-4452-8285-d8f6cd21a48b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:25:07 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdbef1f-2dc2-41ac-b398-4069a0ed2921]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG os_brick.utils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating existing volume attachment record: d6088507-13c3-465c-8d45-601a0cc302aa {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-80ac7d44-08d8-4d51-85ef-6ec09c5fe866 req-6d604437-4133-4453-93cb-006646c089d2 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-80ac7d44-08d8-4d51-85ef-6ec09c5fe866 req-6d604437-4133-4453-93cb-006646c089d2 service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-80ac7d44-08d8-4d51-85ef-6ec09c5fe866 req-6d604437-4133-4453-93cb-006646c089d2 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-80ac7d44-08d8-4d51-85ef-6ec09c5fe866 req-6d604437-4133-4453-93cb-006646c089d2 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-80ac7d44-08d8-4d51-85ef-6ec09c5fe866 req-6d604437-4133-4453-93cb-006646c089d2 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:08 user nova-compute[74233]: WARNING nova.compute.manager [req-80ac7d44-08d8-4d51-85ef-6ec09c5fe866 req-6d604437-4133-4453-93cb-006646c089d2 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state resized and task_state resize_reverting.
Oct 20 18:25:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7546MB free_disk=24.946517944335938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:08 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance running successfully.
Oct 20 18:25:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] finish_revert_migration finished successfully. {{(pid=74233) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 538cde40-8a87-4837-9b1e-05a4c60659fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance debfd120-e237-4afa-9b36-2bed99e48379 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5b5e15d0-98d8-4f35-98ff-41e922792b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a733ecd9-bafe-4cdd-84ce-b1ae4791b7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6e85e54d-3c59-44fd-8140-15d7e00750de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Skipping network cache update for instance because it is Building. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [{"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-538cde40-8a87-4837-9b1e-05a4c60659fb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:25:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:25:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:29 user nova-compute[74233]: INFO nova.compute.manager [None req-2ee14058-bc70-4f60-af84-8318d6553a2d tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance to original state: 'active'
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:25:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Creating image(s)
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:25:29 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Creating image(s)
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Ensure instance console log exists: /opt/stack/data/nova/instances/6e85e54d-3c59-44fd-8140-15d7e00750de/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Start _get_guest_xml network_info=[{"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '7518a63a-0cf1-415a-99bd-fbd9593c80f4', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUICrOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e85e54d-3c59-44fd-8140-15d7e00750de', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1099585-12f0-4d21-83d3-b314017fd66c', 'serial': 'e1099585-12f0-4d21-83d3-b314017fd66c'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:25:29 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:29 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUICrOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:29 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:29 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:29 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb72f4-ffaf-487a-9d7f-79ab4807636b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:25:29 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfbca95-5970-4d58-8525-d187c0fa29ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c] added
Oct 20 18:25:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8137c-5b1e-4b63-865a-101cf4190b72]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80edb7d9-cf56-4b53-92b6-07cc9e8468f4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVUICrOT {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.261s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVUICrOT" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6580be-38aa-4a2c-8887-ac135623f736]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVUICrOT'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:29 user nova-compute[74233]: INFO nova.compute.manager [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Detaching volume 26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:25:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: INFO nova.virt.block_device [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Attempting to driver detach volume 26a9d6c5-25af-46a6-a275-923d13622130 from mountpoint /dev/vdb
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.153s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af162804-5ee9-41a8-9c64-73aae4045bfd]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: INFO nova.compute.manager [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Terminating instance
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk 1073741824" returned: 0 in 0.107s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c683e87a-1462-41f6-9cee-9057dfafcc2a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Attempting to detach device vdb from instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:25:30 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:30 user nova-compute[74233]:   <source dev="/dev/sdf"/>
Oct 20 18:25:30 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:25:30 user nova-compute[74233]:   <serial>26a9d6c5-25af-46a6-a275-923d13622130</serial>
Oct 20 18:25:30 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:25:30 user nova-compute[74233]: </disk>
Oct 20 18:25:30 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:25:30 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully detached device vdb from instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 from the persistent domain config.
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:25:30 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:30 user nova-compute[74233]:   <source dev="/dev/sdf"/>
Oct 20 18:25:30 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:25:30 user nova-compute[74233]:   <serial>26a9d6c5-25af-46a6-a275-923d13622130</serial>
Oct 20 18:25:30 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:25:30 user nova-compute[74233]: </disk>
Oct 20 18:25:30 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfcc5af-4dd9-4dee-8abf-de6a1f8a072b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260]
Oct 20 18:25:30 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260] successful.
Oct 20 18:25:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8850d0-afcd-44b5-a0f3-5a018db29886]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[477964f5-f61c-4734-a1b3-fb3a9c5b292d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:30 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:30 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.721s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d59a25-bf73-4554-a1a8-27e3bf98b9f2]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa631b66-79fd-4310-9588-b6b7c4834168 req-cb142979-9032-4a82-bfda-d0d19c952f01 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-unplugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa631b66-79fd-4310-9588-b6b7c4834168 req-cb142979-9032-4a82-bfda-d0d19c952f01 service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa631b66-79fd-4310-9588-b6b7c4834168 req-cb142979-9032-4a82-bfda-d0d19c952f01 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fa631b66-79fd-4310-9588-b6b7c4834168 req-cb142979-9032-4a82-bfda-d0d19c952f01 service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa631b66-79fd-4310-9588-b6b7c4834168 req-cb142979-9032-4a82-bfda-d0d19c952f01 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-unplugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-fa631b66-79fd-4310-9588-b6b7c4834168 req-cb142979-9032-4a82-bfda-d0d19c952f01 service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-unplugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Cannot resize image /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Start _get_guest_xml network_info=[{"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '8e412492-405e-41b7-ab39-a5c2102fd0e6', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aeb06e35-8797-4a76-a54b-f4d2dbb329d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'serial': 'fa89c49c-d30e-4c1a-9a6a-c725b598c62b'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:25:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 18:25:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'vcpu_model' on Instance uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:25:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:25:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Instance destroyed successfully.
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lazy-loading 'resources' on Instance uuid debfd120-e237-4afa-9b36-2bed99e48379 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1762481964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382179192',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdxvKw/u2/yYNcSmoIIw3OhtKwd9N5pLEhMwvhcYInn0YmmQEqlhhtUrpuAHa9qB1NKrhaBPRWW5SC94JQy/O/YrBBmdOi7KhyHAC4xFBV4fmIstcf3tZGhxFTrqMLAA==',key_name='tempest-keypair-1819207714',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:23:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f91646be9384ebdab36bc6c813cb56e',ramdisk_id='',reservation_id='r-0l0w4hia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1458618408',owner_user_name='tempest-ServerActionsV293TestJSON-1458618408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:23:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9207f9f82e346ec86d29521dc93e221',uuid=debfd120-e237-4afa-9b36-2bed99e48379,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converting VIF {"id": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "address": "fa:16:3e:c7:a1:39", "network": {"id": "67e7dad7-dca5-4d59-94b1-1b89cf742133", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1323264756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f91646be9384ebdab36bc6c813cb56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde94c390-2e", "ovs_interfaceid": "de94c390-2e4c-4ea8-9456-e9f8b242a745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_vif [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde94c390-2e, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46480bd4-ac2c-4728-a5e0-b7a1f09ad197) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:31 user nova-compute[74233]: INFO os_vif [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a1:39,bridge_name='br-int',has_traffic_filtering=True,id=de94c390-2e4c-4ea8-9456-e9f8b242a745,network=Network(67e7dad7-dca5-4d59-94b1-1b89cf742133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde94c390-2e')
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWNCtKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:31 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUICrOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.758s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== connect_volume: return (1760ms) {'type': 'block', 'scsi_wwn': '23966646630656336', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966646630656336', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.811s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:31 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:31 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b79a3-44b1-44bc-8f24-16d4372a5119]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:25:31 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1568364489',display_name='tempest-TestVolumeBootPattern-server-1568364489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1568364489',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-8rxpy1q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:24:55Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=6e85e54d-3c59-44fd-8140-15d7e00750de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e85e54d-3c59-44fd-8140-15d7e00750de {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:25:31 user nova-compute[74233]:   <uuid>6e85e54d-3c59-44fd-8140-15d7e00750de</uuid>
Oct 20 18:25:31 user nova-compute[74233]:   <name>instance-00000024</name>
Oct 20 18:25:31 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:25:31 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:25:31 user nova-compute[74233]:   <metadata>
Oct 20 18:25:31 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:25:31 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:25:31 user nova-compute[74233]:       <nova:name>tempest-TestVolumeBootPattern-server-1568364489</nova:name>
Oct 20 18:25:31 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:25:29</nova:creationTime>
Oct 20 18:25:31 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:25:31 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:25:31 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:25:31 user nova-compute[74233]:       <nova:owner>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:user uuid="10447188fbd74b18ba64fc8e64d267c6">tempest-TestVolumeBootPattern-2006411708-project-member</nova:user>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:project uuid="b592b103d8084815bf6d3132c1215feb">tempest-TestVolumeBootPattern-2006411708</nova:project>
Oct 20 18:25:31 user nova-compute[74233]:       </nova:owner>
Oct 20 18:25:31 user nova-compute[74233]:       <nova:ports>
Oct 20 18:25:31 user nova-compute[74233]:         <nova:port uuid="87fd02ce-7cca-416a-a82b-58ae33042cef">
Oct 20 18:25:31 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:25:31 user nova-compute[74233]:         </nova:port>
Oct 20 18:25:31 user nova-compute[74233]:       </nova:ports>
Oct 20 18:25:31 user nova-compute[74233]:     </nova:instance>
Oct 20 18:25:31 user nova-compute[74233]:   </metadata>
Oct 20 18:25:31 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:25:31 user nova-compute[74233]:     <system>
Oct 20 18:25:31 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:25:31 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:25:31 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:25:31 user nova-compute[74233]:       <entry name="serial">6e85e54d-3c59-44fd-8140-15d7e00750de</entry>
Oct 20 18:25:31 user nova-compute[74233]:       <entry name="uuid">6e85e54d-3c59-44fd-8140-15d7e00750de</entry>
Oct 20 18:25:31 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:25:31 user nova-compute[74233]:     </system>
Oct 20 18:25:31 user nova-compute[74233]:   </sysinfo>
Oct 20 18:25:31 user nova-compute[74233]:   <os>
Oct 20 18:25:31 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:25:31 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:25:31 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:25:31 user nova-compute[74233]:   </os>
Oct 20 18:25:31 user nova-compute[74233]:   <features>
Oct 20 18:25:31 user nova-compute[74233]:     <acpi/>
Oct 20 18:25:31 user nova-compute[74233]:     <apic/>
Oct 20 18:25:31 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:25:31 user nova-compute[74233]:   </features>
Oct 20 18:25:31 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:25:31 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:25:31 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:25:31 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:25:31 user nova-compute[74233]:   </clock>
Oct 20 18:25:31 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:25:31 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:25:31 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:25:31 user nova-compute[74233]:   </cpu>
Oct 20 18:25:31 user nova-compute[74233]:   <devices>
Oct 20 18:25:31 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:25:31 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:31 user nova-compute[74233]:       <source dev="/dev/sdc"/>
Oct 20 18:25:31 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:25:31 user nova-compute[74233]:       <serial>e1099585-12f0-4d21-83d3-b314017fd66c</serial>
Oct 20 18:25:31 user nova-compute[74233]:     </disk>
Oct 20 18:25:31 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:25:31 user nova-compute[74233]:       <mac address="fa:16:3e:c4:b6:f3"/>
Oct 20 18:25:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:31 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:25:31 user nova-compute[74233]:       <target dev="tap87fd02ce-7c"/>
Oct 20 18:25:31 user nova-compute[74233]:     </interface>
Oct 20 18:25:31 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:25:31 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/6e85e54d-3c59-44fd-8140-15d7e00750de/console.log" append="off"/>
Oct 20 18:25:31 user nova-compute[74233]:     </serial>
Oct 20 18:25:31 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:25:31 user nova-compute[74233]:     <video>
Oct 20 18:25:31 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:31 user nova-compute[74233]:     </video>
Oct 20 18:25:31 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:25:31 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:25:31 user nova-compute[74233]:     </rng>
Oct 20 18:25:31 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:25:31 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:25:31 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:25:31 user nova-compute[74233]:     </memballoon>
Oct 20 18:25:31 user nova-compute[74233]:   </devices>
Oct 20 18:25:31 user nova-compute[74233]: </domain>
Oct 20 18:25:31 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1568364489',display_name='tempest-TestVolumeBootPattern-server-1568364489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1568364489',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-8rxpy1q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:24:55Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=6e85e54d-3c59-44fd-8140-15d7e00750de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_vif [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34f131-7884-48b3-94cc-107b00388129]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b] added
Oct 20 18:25:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1cec482-f854-5c04-a859-06b4506ed029', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b1088-d87d-43b7-8a5c-237b4d29bb8d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87fd02ce-7c, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87fd02ce-7c, col_values=(('qos', UUID('afbfc62f-5192-4b87-bc70-32f0bd99a878')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87fd02ce-7c, col_values=(('external_ids', {'iface-id': '87fd02ce-7cca-416a-a82b-58ae33042cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:b6:f3', 'vm-uuid': '6e85e54d-3c59-44fd-8140-15d7e00750de'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:31 user nova-compute[74233]: INFO os_vif [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c')
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a304db-8bc6-428c-817f-d535afd73023]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZpOvAqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZpOvAqn" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d687e-4f9f-4c59-b8b1-33e65dad88ae]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JZpOvAqn'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ae8ef-9009-4855-b6c6-7440102cf9d8]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] No VIF found with MAC fa:16:3e:c4:b6:f3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af70850f-9dfb-47cf-b799-d47bbcf65c7c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f974799d-6c0c-4df5-b67d-ccfbc06fe0aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]
Oct 20 18:25:31 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.
Oct 20 18:25:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3be69c-a8cf-45e0-92e6-a02308612914]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51059d3-ac40-49f4-b680-215709d1c414]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:31 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab0c6d-6852-451a-80f2-1fe4e2508dc3]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:25:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-23b49a95-26b5-402d-b1b5-fdbaefb86918 req-ea30d55e-8143-4b96-b95d-af21e3c1d7bd service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b49a95-26b5-402d-b1b5-fdbaefb86918 req-ea30d55e-8143-4b96-b95d-af21e3c1d7bd service nova] Acquiring lock "debfd120-e237-4afa-9b36-2bed99e48379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b49a95-26b5-402d-b1b5-fdbaefb86918 req-ea30d55e-8143-4b96-b95d-af21e3c1d7bd service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b49a95-26b5-402d-b1b5-fdbaefb86918 req-ea30d55e-8143-4b96-b95d-af21e3c1d7bd service nova] Lock "debfd120-e237-4afa-9b36-2bed99e48379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.compute.manager [req-23b49a95-26b5-402d-b1b5-fdbaefb86918 req-ea30d55e-8143-4b96-b95d-af21e3c1d7bd service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] No waiting events found dispatching network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:32 user nova-compute[74233]: WARNING nova.compute.manager [req-23b49a95-26b5-402d-b1b5-fdbaefb86918 req-ea30d55e-8143-4b96-b95d-af21e3c1d7bd service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received unexpected event network-vif-plugged-de94c390-2e4c-4ea8-9456-e9f8b242a745 for instance with vm_state active and task_state deleting.
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuCrLqQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== connect_volume: return (2210ms) {'type': 'block', 'scsi_wwn': '26538396636373038', 'path': '/dev/sdh'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538396636373038', 'path': '/dev/sdh'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.727s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-13211816',display_name='tempest-ServerActionsTestOtherA-server-1359886685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-13211816',id=32,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDkG3eixSC9gYo6kNgsId3y7xJBVqfNTJcfeDkXB4fKSG6GYa7Hxh97vm3lDnEBW3Dhhhctco6EJLFmoisxDflzxlnK3Z6N6U7kZND6xrKsWC9Kbr/+pjFjQ0QfP6rlvw==',key_name='tempest-keypair-142935039',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:22:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-mhezx8yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=aeb06e35-8797-4a76-a54b-f4d2dbb329d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:25:32 user nova-compute[74233]:   <uuid>aeb06e35-8797-4a76-a54b-f4d2dbb329d3</uuid>
Oct 20 18:25:32 user nova-compute[74233]:   <name>instance-00000020</name>
Oct 20 18:25:32 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:25:32 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:25:32 user nova-compute[74233]:   <metadata>
Oct 20 18:25:32 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:25:32 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:25:32 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherA-server-1359886685</nova:name>
Oct 20 18:25:32 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:25:30</nova:creationTime>
Oct 20 18:25:32 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:25:32 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:25:32 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:25:32 user nova-compute[74233]:       <nova:owner>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:user uuid="d132de50b442419e8f3a059e650902e7">tempest-ServerActionsTestOtherA-835796467-project-member</nova:user>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:project uuid="0083be86b8f04d16a891eadad4dccbe6">tempest-ServerActionsTestOtherA-835796467</nova:project>
Oct 20 18:25:32 user nova-compute[74233]:       </nova:owner>
Oct 20 18:25:32 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:25:32 user nova-compute[74233]:       <nova:ports>
Oct 20 18:25:32 user nova-compute[74233]:         <nova:port uuid="10c936e6-7609-4bd3-9374-e18e5503c689">
Oct 20 18:25:32 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:25:32 user nova-compute[74233]:         </nova:port>
Oct 20 18:25:32 user nova-compute[74233]:       </nova:ports>
Oct 20 18:25:32 user nova-compute[74233]:     </nova:instance>
Oct 20 18:25:32 user nova-compute[74233]:   </metadata>
Oct 20 18:25:32 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:25:32 user nova-compute[74233]:     <system>
Oct 20 18:25:32 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:25:32 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:25:32 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:25:32 user nova-compute[74233]:       <entry name="serial">aeb06e35-8797-4a76-a54b-f4d2dbb329d3</entry>
Oct 20 18:25:32 user nova-compute[74233]:       <entry name="uuid">aeb06e35-8797-4a76-a54b-f4d2dbb329d3</entry>
Oct 20 18:25:32 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:25:32 user nova-compute[74233]:     </system>
Oct 20 18:25:32 user nova-compute[74233]:   </sysinfo>
Oct 20 18:25:32 user nova-compute[74233]:   <os>
Oct 20 18:25:32 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:25:32 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:25:32 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:25:32 user nova-compute[74233]:   </os>
Oct 20 18:25:32 user nova-compute[74233]:   <features>
Oct 20 18:25:32 user nova-compute[74233]:     <acpi/>
Oct 20 18:25:32 user nova-compute[74233]:     <apic/>
Oct 20 18:25:32 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:25:32 user nova-compute[74233]:   </features>
Oct 20 18:25:32 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:25:32 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:25:32 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:25:32 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:25:32 user nova-compute[74233]:   </clock>
Oct 20 18:25:32 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:25:32 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:25:32 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:25:32 user nova-compute[74233]:   </cpu>
Oct 20 18:25:32 user nova-compute[74233]:   <devices>
Oct 20 18:25:32 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:25:32 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:25:32 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk"/>
Oct 20 18:25:32 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:25:32 user nova-compute[74233]:     </disk>
Oct 20 18:25:32 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:25:32 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:32 user nova-compute[74233]:       <source dev="/dev/sdh"/>
Oct 20 18:25:32 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:25:32 user nova-compute[74233]:       <serial>fa89c49c-d30e-4c1a-9a6a-c725b598c62b</serial>
Oct 20 18:25:32 user nova-compute[74233]:     </disk>
Oct 20 18:25:32 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:25:32 user nova-compute[74233]:       <mac address="fa:16:3e:1d:b1:ef"/>
Oct 20 18:25:32 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:32 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:25:32 user nova-compute[74233]:       <target dev="tap10c936e6-76"/>
Oct 20 18:25:32 user nova-compute[74233]:     </interface>
Oct 20 18:25:32 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:25:32 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/console.log" append="off"/>
Oct 20 18:25:32 user nova-compute[74233]:     </serial>
Oct 20 18:25:32 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:25:32 user nova-compute[74233]:     <video>
Oct 20 18:25:32 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:32 user nova-compute[74233]:     </video>
Oct 20 18:25:32 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:25:32 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:25:32 user nova-compute[74233]:     </rng>
Oct 20 18:25:32 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:25:32 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:25:32 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:25:32 user nova-compute[74233]:     </memballoon>
Oct 20 18:25:32 user nova-compute[74233]:   </devices>
Oct 20 18:25:32 user nova-compute[74233]: </domain>
Oct 20 18:25:32 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-13211816',display_name='tempest-ServerActionsTestOtherA-server-1359886685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-13211816',id=32,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDkG3eixSC9gYo6kNgsId3y7xJBVqfNTJcfeDkXB4fKSG6GYa7Hxh97vm3lDnEBW3Dhhhctco6EJLFmoisxDflzxlnK3Z6N6U7kZND6xrKsWC9Kbr/+pjFjQ0QfP6rlvw==',key_name='tempest-keypair-142935039',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:22:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-mhezx8yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=aeb06e35-8797-4a76-a54b-f4d2dbb329d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82ab56-559b-48ab-bb8f-2381d672933a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:25:32 user nova-compute[74233]: No targets found.
Oct 20 18:25:32 user nova-compute[74233]: iSNS:
Oct 20 18:25:32 user nova-compute[74233]: No targets found.
Oct 20 18:25:32 user nova-compute[74233]: STATIC:
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:25:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:32 user nova-compute[74233]: FIRMWARE:
Oct 20 18:25:32 user nova-compute[74233]: No targets found.
Oct 20 18:25:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:25:32 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:25:32 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c1d4a55-36f8-52d7-99b3-1b1bd4bcfdef', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76ac6a3-6f51-45f6-a655-72b2384f72c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10c936e6-76, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10c936e6-76, col_values=(('qos', UUID('84825548-61b6-45fa-8bbd-f857e21fb0ab')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10c936e6-76, col_values=(('external_ids', {'iface-id': '10c936e6-7609-4bd3-9374-e18e5503c689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:b1:ef', 'vm-uuid': 'aeb06e35-8797-4a76-a54b-f4d2dbb329d3'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: INFO os_vif [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76')
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63137c3-299d-44c9-907b-f32ff3317116]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:32 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950746170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b46f0a0-1587-472a-ae1b-62000b044639]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No VIF found with MAC fa:16:3e:1d:b1:ef, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79af5ec-5658-4fe2-b39e-55c372a0b9ce]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847a08a-b11f-4cb9-acb7-ce26f98c4695]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa464b-a4de-4299-b2fb-fbddd1d1d444]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2dd7e1-78b0-4c75-8351-814de5a78dc9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d8d42-d3b8-4c73-becb-8cce763b494c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260]
Oct 20 18:25:33 user nova-compute[74233]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509, portal: 172.16.0.220,3260] successful.
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-23ad7f47-970c-4d0f-a043-02af6afeefe7 req-d6c9b7bd-8245-4d8b-a3c7-bc94d0c4739a service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23ad7f47-970c-4d0f-a043-02af6afeefe7 req-d6c9b7bd-8245-4d8b-a3c7-bc94d0c4739a service nova] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23ad7f47-970c-4d0f-a043-02af6afeefe7 req-d6c9b7bd-8245-4d8b-a3c7-bc94d0c4739a service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23ad7f47-970c-4d0f-a043-02af6afeefe7 req-d6c9b7bd-8245-4d8b-a3c7-bc94d0c4739a service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-23ad7f47-970c-4d0f-a043-02af6afeefe7 req-d6c9b7bd-8245-4d8b-a3c7-bc94d0c4739a service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] No waiting events found dispatching network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:33 user nova-compute[74233]: WARNING nova.compute.manager [req-23ad7f47-970c-4d0f-a043-02af6afeefe7 req-d6c9b7bd-8245-4d8b-a3c7-bc94d0c4739a service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received unexpected event network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef for instance with vm_state building and task_state spawning.
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:600c0d7b-697c-467c-8d7e-061bd4cb2509 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a3b97-51aa-448e-9a44-646d4bb75039]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] <== disconnect_volume: return (2146ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:25:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Deleting instance files /opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379_del
Oct 20 18:25:33 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Deletion of /opt/stack/data/nova/instances/debfd120-e237-4afa-9b36-2bed99e48379_del complete
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.476s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:33 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:33 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:25:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5357c000-9451-4f96-a2d3-151666bbd307]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:25:33 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a56bd-1882-43e2-b930-31adc1f62add]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa] added
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: INFO nova.compute.manager [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Took 3.24 seconds to destroy the instance on the hypervisor.
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3711b1a-d63c-44e0-921c-7f19677b30a6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d90f7c-4014-4419-893e-5c8a28d40239]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuCrLqQi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuCrLqQi" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dea78c4-a2f0-4a99-b495-ae3c141c5b28]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fuCrLqQi'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[581e11be-08f5-45fa-ab59-b9eaa4ae9dd2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb7967-456d-4345-a33a-b2f8e33961aa]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[484d25f3-7568-4fb4-87c0-db7bb5091946]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260]
Oct 20 18:25:33 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260] successful.
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7962bf-af57-4772-89d4-315d3baf4f4d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e89bdf-bb65-4228-8134-e70afd9d42c4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:33 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:25:33 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0e7154-029f-494b-87a1-35ff6d6a36a1]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:33 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:25:34 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Took 0.91 seconds to deallocate network for instance.
Oct 20 18:25:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-87f38e0b-c0ea-47b8-97ec-2abc9e5cd367 req-186dad30-16f0-450a-b18e-3c1bece0a9ba service nova] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Received event network-vif-deleted-de94c390-2e4c-4ea8-9456-e9f8b242a745 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuCrLqQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] <== connect_volume: return (1886ms) {'type': 'block', 'scsi_wwn': '26362346232313835', 'path': '/dev/sde'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362346232313835', 'path': '/dev/sde'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'flavor' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:25:34 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:34 user nova-compute[74233]:   <source dev="/dev/sde"/>
Oct 20 18:25:34 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:25:34 user nova-compute[74233]:   <serial>4ef4a842-4d4f-4db3-bb79-0ac8390d25aa</serial>
Oct 20 18:25:34 user nova-compute[74233]: </disk>
Oct 20 18:25:34 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-5a97b159-cea8-4d48-bceb-9f31b523c17e req-0fb0f688-e9ad-404a-a982-d8e4245a2441 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5a97b159-cea8-4d48-bceb-9f31b523c17e req-0fb0f688-e9ad-404a-a982-d8e4245a2441 service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5a97b159-cea8-4d48-bceb-9f31b523c17e req-0fb0f688-e9ad-404a-a982-d8e4245a2441 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5a97b159-cea8-4d48-bceb-9f31b523c17e req-0fb0f688-e9ad-404a-a982-d8e4245a2441 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-5a97b159-cea8-4d48-bceb-9f31b523c17e req-0fb0f688-e9ad-404a-a982-d8e4245a2441 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:35 user nova-compute[74233]: WARNING nova.compute.manager [req-5a97b159-cea8-4d48-bceb-9f31b523c17e req-0fb0f688-e9ad-404a-a982-d8e4245a2441 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 18:25:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:35 user nova-compute[74233]: INFO nova.compute.manager [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Took 0.93 seconds to detach 1 volumes for instance.
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] [instance: debfd120-e237-4afa-9b36-2bed99e48379] Deleting volume: 600c0d7b-697c-467c-8d7e-061bd4cb2509 {{(pid=74233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:cb:cf:83, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-e5d3c266-8d3b-48dc-8191-b3656312ead8 req-a26443be-d10c-455b-ac16-53dfa6529d62 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5d3c266-8d3b-48dc-8191-b3656312ead8 req-a26443be-d10c-455b-ac16-53dfa6529d62 service nova] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5d3c266-8d3b-48dc-8191-b3656312ead8 req-a26443be-d10c-455b-ac16-53dfa6529d62 service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5d3c266-8d3b-48dc-8191-b3656312ead8 req-a26443be-d10c-455b-ac16-53dfa6529d62 service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-e5d3c266-8d3b-48dc-8191-b3656312ead8 req-a26443be-d10c-455b-ac16-53dfa6529d62 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] No waiting events found dispatching network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:35 user nova-compute[74233]: WARNING nova.compute.manager [req-e5d3c266-8d3b-48dc-8191-b3656312ead8 req-a26443be-d10c-455b-ac16-53dfa6529d62 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received unexpected event network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef for instance with vm_state building and task_state spawning.
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9d45e904-6f0b-432c-9b24-49dd7aecc963 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.620s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:25:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:35 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Deleted allocations for instance debfd120-e237-4afa-9b36-2bed99e48379
Oct 20 18:25:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8a95431c-a76d-4c14-8e35-20ee4cfa22e3 tempest-ServerActionsV293TestJSON-1458618408 tempest-ServerActionsV293TestJSON-1458618408-project-member] Lock "debfd120-e237-4afa-9b36-2bed99e48379" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.933s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:36 user nova-compute[74233]: INFO nova.compute.manager [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Rescuing
Oct 20 18:25:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:25:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:25:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:25:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:25:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:25:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-c3f1d229-586d-48f4-af17-f986bcc997f8 req-1b726e37-6c8c-407b-ae70-971778d929b6 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c3f1d229-586d-48f4-af17-f986bcc997f8 req-1b726e37-6c8c-407b-ae70-971778d929b6 service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c3f1d229-586d-48f4-af17-f986bcc997f8 req-1b726e37-6c8c-407b-ae70-971778d929b6 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c3f1d229-586d-48f4-af17-f986bcc997f8 req-1b726e37-6c8c-407b-ae70-971778d929b6 service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-c3f1d229-586d-48f4-af17-f986bcc997f8 req-1b726e37-6c8c-407b-ae70-971778d929b6 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:37 user nova-compute[74233]: WARNING nova.compute.manager [req-c3f1d229-586d-48f4-af17-f986bcc997f8 req-1b726e37-6c8c-407b-ae70-971778d929b6 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Instance spawned successfully.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:37 user nova-compute[74233]: WARNING nova.compute.manager [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state active and task_state rescuing.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:37 user nova-compute[74233]: WARNING nova.compute.manager [req-5984b347-d7a2-4248-b134-5f5d599613b7 req-b7656eb0-a95d-41e8-bc74-cc47a14102ef service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state active and task_state rescuing.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Took 7.90 seconds to spawn the instance on the hypervisor.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance spawned successfully.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.compute.manager [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Took 43.04 seconds to build instance.
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e6a68e1-aa21-478c-9a41-a8d16850278a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.136s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance destroyed successfully.
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Attempting rescue
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Creating image(s)
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74233) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: INFO nova.compute.manager [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Terminating instance
Oct 20 18:25:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2506021a-1df1-410d-8510-f70b243f42e2 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.132s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.226s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:37 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue" returned: 0 in 0.068s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'migration_context' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.base [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<2753b305-f0cb-409c-b66a-e06a99378c08> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Start _get_guest_xml network_info=[{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:cb:cf:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'resources' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.base [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<2753b305-f0cb-409c-b66a-e06a99378c08> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'numa_topology' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.base [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<2753b305-f0cb-409c-b66a-e06a99378c08> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:25:38 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:38 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.base [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<2753b305-f0cb-409c-b66a-e06a99378c08> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266827241',display_name='tempest-ServerRescueNegativeTestJSON-server-1266827241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266827241',id=35,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAnd2569lRXlRuOBKhGNt53usojGkjn2y9Rrev1olWo2VXMzLNTKwAbsZhdkHOGj+k8dBqGvILvC2hTQNn+lB3TXMN83LM2EfXEc/y6YHPaJDstVx51RQ6RNE78Ol0bmg==',key_name='tempest-keypair-1823172263',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:23:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-kullwdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=2753b305-f0cb-409c-b66a-e06a99378c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:cb:cf:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "vif_mac": "fa:16:3e:cb:cf:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'pci_devices' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.objects.base [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Object Instance<2753b305-f0cb-409c-b66a-e06a99378c08> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:25:38 user nova-compute[74233]:   <uuid>2753b305-f0cb-409c-b66a-e06a99378c08</uuid>
Oct 20 18:25:38 user nova-compute[74233]:   <name>instance-00000023</name>
Oct 20 18:25:38 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:25:38 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:25:38 user nova-compute[74233]:   <metadata>
Oct 20 18:25:38 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:25:38 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:25:38 user nova-compute[74233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1266827241</nova:name>
Oct 20 18:25:38 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:25:38</nova:creationTime>
Oct 20 18:25:38 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:25:38 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:25:38 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:25:38 user nova-compute[74233]:       <nova:owner>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:user uuid="15b21695cdfe4b4299fb08403ed15ddd">tempest-ServerRescueNegativeTestJSON-226182355-project-member</nova:user>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:project uuid="51e847f3ff044181bb615138361ec8da">tempest-ServerRescueNegativeTestJSON-226182355</nova:project>
Oct 20 18:25:38 user nova-compute[74233]:       </nova:owner>
Oct 20 18:25:38 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:25:38 user nova-compute[74233]:       <nova:ports>
Oct 20 18:25:38 user nova-compute[74233]:         <nova:port uuid="157e864c-8ac5-422d-a7a1-7252ef76cee1">
Oct 20 18:25:38 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:25:38 user nova-compute[74233]:         </nova:port>
Oct 20 18:25:38 user nova-compute[74233]:       </nova:ports>
Oct 20 18:25:38 user nova-compute[74233]:     </nova:instance>
Oct 20 18:25:38 user nova-compute[74233]:   </metadata>
Oct 20 18:25:38 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:25:38 user nova-compute[74233]:     <system>
Oct 20 18:25:38 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:25:38 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:25:38 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:25:38 user nova-compute[74233]:       <entry name="serial">2753b305-f0cb-409c-b66a-e06a99378c08</entry>
Oct 20 18:25:38 user nova-compute[74233]:       <entry name="uuid">2753b305-f0cb-409c-b66a-e06a99378c08</entry>
Oct 20 18:25:38 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:25:38 user nova-compute[74233]:     </system>
Oct 20 18:25:38 user nova-compute[74233]:   </sysinfo>
Oct 20 18:25:38 user nova-compute[74233]:   <os>
Oct 20 18:25:38 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:25:38 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:25:38 user nova-compute[74233]:   </os>
Oct 20 18:25:38 user nova-compute[74233]:   <features>
Oct 20 18:25:38 user nova-compute[74233]:     <acpi/>
Oct 20 18:25:38 user nova-compute[74233]:     <apic/>
Oct 20 18:25:38 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:25:38 user nova-compute[74233]:   </features>
Oct 20 18:25:38 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:25:38 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:25:38 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:25:38 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:25:38 user nova-compute[74233]:   </clock>
Oct 20 18:25:38 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:25:38 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:25:38 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:25:38 user nova-compute[74233]:   </cpu>
Oct 20 18:25:38 user nova-compute[74233]:   <devices>
Oct 20 18:25:38 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:25:38 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:25:38 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue"/>
Oct 20 18:25:38 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:25:38 user nova-compute[74233]:     </disk>
Oct 20 18:25:38 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:25:38 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:25:38 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk"/>
Oct 20 18:25:38 user nova-compute[74233]:       <target dev="vdb" bus="virtio"/>
Oct 20 18:25:38 user nova-compute[74233]:     </disk>
Oct 20 18:25:38 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:25:38 user nova-compute[74233]:       <mac address="fa:16:3e:cb:cf:83"/>
Oct 20 18:25:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:38 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:25:38 user nova-compute[74233]:       <target dev="tap157e864c-8a"/>
Oct 20 18:25:38 user nova-compute[74233]:     </interface>
Oct 20 18:25:38 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:25:38 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/console.log" append="off"/>
Oct 20 18:25:38 user nova-compute[74233]:     </serial>
Oct 20 18:25:38 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:25:38 user nova-compute[74233]:     <video>
Oct 20 18:25:38 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:25:38 user nova-compute[74233]:     </video>
Oct 20 18:25:38 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:25:38 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:25:38 user nova-compute[74233]:     </rng>
Oct 20 18:25:38 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:25:38 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:25:38 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:25:38 user nova-compute[74233]:     </memballoon>
Oct 20 18:25:38 user nova-compute[74233]:   </devices>
Oct 20 18:25:38 user nova-compute[74233]: </domain>
Oct 20 18:25:38 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:25:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance destroyed successfully.
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] No VIF found with MAC fa:16:3e:cb:cf:83, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Instance destroyed successfully.
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.objects.instance [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lazy-loading 'resources' on Instance uuid 538cde40-8a87-4837-9b1e-05a4c60659fb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980793586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980793586',id=2,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c937ee3474848de8b761d88e32f6447',ramdisk_id='',reservation_id='r-5ou4bmg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-481267461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:07:55Z,user_data=None,user_id='a5149d5d6d1f486c87a0c808597a40f3',uuid=538cde40-8a87-4837-9b1e-05a4c60659fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converting VIF {"id": "af2e219f-81be-4408-8b13-f318d6ed98a3", "address": "fa:16:3e:62:e7:2f", "network": {"id": "8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1274489802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c937ee3474848de8b761d88e32f6447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2e219f-81", "ovs_interfaceid": "af2e219f-81be-4408-8b13-f318d6ed98a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG os_vif [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf2e219f-81, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-unplugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-unplugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-unplugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:39 user nova-compute[74233]: WARNING nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state active and task_state deleting.
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:39 user nova-compute[74233]: WARNING nova.compute.manager [req-1965cbb8-1a31-4006-8e3d-61484317e346 req-e937b32b-bc9b-41fa-85b1-cf51d4baba3c service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state active and task_state deleting.
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fbcedd6-81b8-4f65-9358-8ad4e06c7984) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: INFO os_vif [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e7:2f,bridge_name='br-int',has_traffic_filtering=True,id=af2e219f-81be-4408-8b13-f318d6ed98a3,network=Network(8992b55b-8d7c-4d73-bc0d-3a16d9f7adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2e219f-81')
Oct 20 18:25:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Deleting instance files /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb_del
Oct 20 18:25:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Deletion of /opt/stack/data/nova/instances/538cde40-8a87-4837-9b1e-05a4c60659fb_del complete
Oct 20 18:25:39 user nova-compute[74233]: INFO nova.compute.manager [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Took 1.61 seconds to destroy the instance on the hypervisor.
Oct 20 18:25:39 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:25:40 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Took 0.65 seconds to deallocate network for instance.
Oct 20 18:25:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-b5f26529-03fd-4598-af3f-85e4d26e3cb7 req-b5464864-7920-402e-89ce-12182f96a772 service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-deleted-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:40 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Deleted allocations for instance 538cde40-8a87-4837-9b1e-05a4c60659fb
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-76490b21-75b9-4b02-bbf7-d6f636ea48b5 tempest-ServerBootFromVolumeStableRescueTest-481267461 tempest-ServerBootFromVolumeStableRescueTest-481267461-project-member] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.178s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:41 user nova-compute[74233]: WARNING nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state deleted and task_state None.
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-unplugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-unplugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:41 user nova-compute[74233]: WARNING nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-unplugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state deleted and task_state None.
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Acquiring lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "538cde40-8a87-4837-9b1e-05a4c60659fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] No waiting events found dispatching network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:41 user nova-compute[74233]: WARNING nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 538cde40-8a87-4837-9b1e-05a4c60659fb] Received unexpected event network-vif-plugged-af2e219f-81be-4408-8b13-f318d6ed98a3 for instance with vm_state deleted and task_state None.
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:41 user nova-compute[74233]: WARNING nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state active and task_state rescuing.
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:41 user nova-compute[74233]: WARNING nova.compute.manager [req-4f51503c-ba88-4694-8e02-e6fdb589bcda req-95c939b7-72d9-44c1-83c2-4b1da682d10e service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state active and task_state rescuing.
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:41 user nova-compute[74233]: INFO nova.compute.manager [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Detaching volume 3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:25:41 user nova-compute[74233]: INFO nova.virt.block_device [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attempting to driver detach volume 3c10d089-eddf-4b2f-a894-90aaa74b5e73 from mountpoint /dev/vdb
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Attempting to detach device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:25:41 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:41 user nova-compute[74233]:   <source dev="/dev/sdg"/>
Oct 20 18:25:41 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:25:41 user nova-compute[74233]:   <serial>3c10d089-eddf-4b2f-a894-90aaa74b5e73</serial>
Oct 20 18:25:41 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:25:41 user nova-compute[74233]: </disk>
Oct 20 18:25:41 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:25:41 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config.
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:25:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:25:41 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:25:41 user nova-compute[74233]:   <source dev="/dev/sdg"/>
Oct 20 18:25:41 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:25:41 user nova-compute[74233]:   <serial>3c10d089-eddf-4b2f-a894-90aaa74b5e73</serial>
Oct 20 18:25:41 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:25:41 user nova-compute[74233]: </disk>
Oct 20 18:25:41 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:25:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:25:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9e698b29-d76d-40d6-8043-b29867aa4c3c tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:25:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:50 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 is timed out.
Oct 20 18:25:50 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully detached device vdb from instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210 from the live domain config.
Oct 20 18:25:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIoucXLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:50 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18b898b-8a5f-4cec-a62b-5dce44382665]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:25:50 user nova-compute[74233]: No targets found.
Oct 20 18:25:50 user nova-compute[74233]: iSNS:
Oct 20 18:25:50 user nova-compute[74233]: No targets found.
Oct 20 18:25:50 user nova-compute[74233]: STATIC:
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:25:50 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:50 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:50 user nova-compute[74233]: FIRMWARE:
Oct 20 18:25:50 user nova-compute[74233]: No targets found.
Oct 20 18:25:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:25:50 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:25:50 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321ca99-c3df-4ac5-b559-b950513b7661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c95fa-3f04-4734-ac8e-506b5ed24970]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:25:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:50 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:25:50 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb95079cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130'): ({'sdf'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Removing single pathed devices sdf {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39da366c-1b24-42cf-bfef-815c063ae93f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b253971-47d0-4db0-8a09-767ec6a91816]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Flushing IO for device /dev/sdf {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14db51c-4cd6-418d-8427-18be9cfafe54]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:25:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6858ea1c-f2af-4003-a999-ab87af91836b]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] SCSI volumes sdf have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[800708f8-4b92-4d4a-b6a0-a854d434e293]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb17be-58a0-49a8-b691-4a961f1766c2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260]
Oct 20 18:25:51 user nova-compute[74233]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130, portal: 172.16.0.220,3260] successful.
Oct 20 18:25:51 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdf188a-8799-4518-8b26-4d64f26bd10f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== disconnect_volume: return (444ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'flavor' on Instance uuid 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-551b7477-aa06-431a-a64c-ae44e936225f tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.405s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.123s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:52 user nova-compute[74233]: INFO nova.compute.manager [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Terminating instance
Oct 20 18:25:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-be8cfaa8-45dc-4f39-9e1a-9d905b3d9e56 req-d5e3fcee-f8c9-422c-bf8e-fec2c81ff6af service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-vif-unplugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-be8cfaa8-45dc-4f39-9e1a-9d905b3d9e56 req-d5e3fcee-f8c9-422c-bf8e-fec2c81ff6af service nova] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-be8cfaa8-45dc-4f39-9e1a-9d905b3d9e56 req-d5e3fcee-f8c9-422c-bf8e-fec2c81ff6af service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-be8cfaa8-45dc-4f39-9e1a-9d905b3d9e56 req-d5e3fcee-f8c9-422c-bf8e-fec2c81ff6af service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-be8cfaa8-45dc-4f39-9e1a-9d905b3d9e56 req-d5e3fcee-f8c9-422c-bf8e-fec2c81ff6af service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] No waiting events found dispatching network-vif-unplugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-be8cfaa8-45dc-4f39-9e1a-9d905b3d9e56 req-d5e3fcee-f8c9-422c-bf8e-fec2c81ff6af service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-vif-unplugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:25:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Instance destroyed successfully.
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'resources' on Instance uuid 0b81120b-9d1d-45e9-88c3-e9eaca49c210 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2067294774',display_name='tempest-VolumesSnapshotTestJSON-instance-2067294774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2067294774',id=31,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADxm7BlI8AmWAo99SjWM7E0dqGLBsg7clsaTc1oEV8+Pr7jlqts4OCLj3sMul37JDW9imggglrWLxA5mc4/xRG0uZ+5wRoQ3J5Mb+Ahc4sH0JHNIFIsiLxScTP04DMlMw==',key_name='tempest-keypair-1228422228',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9b3d85046f4cf78cd79703b467f80e',ramdisk_id='',reservation_id='r-mgf5huem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1067753256',owner_user_name='tempest-VolumesSnapshotTestJSON-1067753256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d29b4bd2074808898ec96be8e0e471',uuid=0b81120b-9d1d-45e9-88c3-e9eaca49c210,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converting VIF {"id": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "address": "fa:16:3e:df:75:a0", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede62683-5c", "ovs_interfaceid": "ede62683-5cec-4a67-93a3-e8a29411c4b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_vif [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapede62683-5c, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2fed8f8-2b84-46a0-bfc4-84dbc7f30d8c) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:53 user nova-compute[74233]: INFO os_vif [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=ede62683-5cec-4a67-93a3-e8a29411c4b0,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede62683-5c')
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIoucXLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:25:53 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcfa6de-a7a2-484d-89c0-486f24a87bd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:25:53 user nova-compute[74233]: No targets found.
Oct 20 18:25:53 user nova-compute[74233]: iSNS:
Oct 20 18:25:53 user nova-compute[74233]: No targets found.
Oct 20 18:25:53 user nova-compute[74233]: STATIC:
Oct 20 18:25:53 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:25:53 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:53 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:53 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:25:53 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:53 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:53 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:25:53 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:53 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:53 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:25:53 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:53 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:53 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c
Oct 20 18:25:53 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:53 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:53 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:25:53 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:25:53 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:25:53 user nova-compute[74233]: FIRMWARE:
Oct 20 18:25:53 user nova-compute[74233]: No targets found.
Oct 20 18:25:53 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:25:53 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:25:53 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26a9d6c5-25af-46a6-a275-923d13622130', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[451fe630-ab50-4ab7-8256-8a08c7351ee3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2b1a08-8cc5-4591-b13b-d84ce830622d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:25:53 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:25:53 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:25:53 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9507467a0>, {}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Disconnecting from: [] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== disconnect_volume: return (82ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:25:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Deleting instance files /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210_del
Oct 20 18:25:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Deletion of /opt/stack/data/nova/instances/0b81120b-9d1d-45e9-88c3-e9eaca49c210_del complete
Oct 20 18:25:53 user nova-compute[74233]: INFO nova.compute.manager [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 20 18:25:53 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:25:53 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:25:54 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Took 0.78 seconds to deallocate network for instance.
Oct 20 18:25:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c63b61cb-bb41-4603-9387-97a80daf0fd6 req-4c1fad27-3691-42e0-ab3a-101e5c92aec8 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-vif-deleted-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:54 user nova-compute[74233]: WARNING nova.volume.cinder [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Attachment c983181a-f23f-4098-8cd7-92b69f65796b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c983181a-f23f-4098-8cd7-92b69f65796b. (HTTP 404) (Request-ID: req-9d8d25b0-1099-4925-8e80-ef62f2dafa82)
Oct 20 18:25:54 user nova-compute[74233]: INFO nova.compute.manager [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:54 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Deleted allocations for instance 0b81120b-9d1d-45e9-88c3-e9eaca49c210
Oct 20 18:25:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-0f1953d3-4899-41fc-8b17-4db1668d9994 req-5ee867e6-3d7c-4244-99bc-37e724532dc2 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received event network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0f1953d3-4899-41fc-8b17-4db1668d9994 req-5ee867e6-3d7c-4244-99bc-37e724532dc2 service nova] Acquiring lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0f1953d3-4899-41fc-8b17-4db1668d9994 req-5ee867e6-3d7c-4244-99bc-37e724532dc2 service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0f1953d3-4899-41fc-8b17-4db1668d9994 req-5ee867e6-3d7c-4244-99bc-37e724532dc2 service nova] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-0f1953d3-4899-41fc-8b17-4db1668d9994 req-5ee867e6-3d7c-4244-99bc-37e724532dc2 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] No waiting events found dispatching network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:25:54 user nova-compute[74233]: WARNING nova.compute.manager [req-0f1953d3-4899-41fc-8b17-4db1668d9994 req-5ee867e6-3d7c-4244-99bc-37e724532dc2 service nova] [instance: 0b81120b-9d1d-45e9-88c3-e9eaca49c210] Received unexpected event network-vif-plugged-ede62683-5cec-4a67-93a3-e8a29411c4b0 for instance with vm_state deleted and task_state None.
Oct 20 18:25:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bed013da-6433-46ef-b636-892086300049 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "0b81120b-9d1d-45e9-88c3-e9eaca49c210" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.527s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:25:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:25:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:02 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 is timed out.
Oct 20 18:26:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config.
Oct 20 18:26:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIpUCyxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:26:02 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9106d254-c809-45cf-9a81-c1eb8c13d51b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:26:02 user nova-compute[74233]: No targets found.
Oct 20 18:26:02 user nova-compute[74233]: iSNS:
Oct 20 18:26:02 user nova-compute[74233]: No targets found.
Oct 20 18:26:02 user nova-compute[74233]: STATIC:
Oct 20 18:26:02 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:26:02 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:02 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:02 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:26:02 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:02 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:02 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:26:02 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:02 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:02 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73
Oct 20 18:26:02 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:02 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:02 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c
Oct 20 18:26:02 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:02 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:02 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:26:02 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:02 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:02 user nova-compute[74233]: FIRMWARE:
Oct 20 18:26:02 user nova-compute[74233]: No targets found.
Oct 20 18:26:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:26:02 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:26:02 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90fe353-95e6-4d28-8069-3916a3c9515d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2cc4e8-d19d-4658-aea8-2f0cac974812]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:26:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:26:02 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:26:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb97034fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73'): ({'sdg'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Removing single pathed devices sdg {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc6054-425a-48ec-a147-1cf746204025]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b76f698-905c-40f3-ac8c-63b97fdc1d46]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Flushing IO for device /dev/sdg {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f01ac-76d4-4c7d-9e94-a51876f5e80c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8eabb4-d2e0-4454-aa6a-aafa589f0993]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] SCSI volumes sdg have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.070s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb3d05-dc4f-4c8d-8de7-ba5eb61ca720]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bf8e5c-4b30-4b98-bce6-7c5f026a080d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260]
Oct 20 18:26:02 user nova-compute[74233]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73, portal: 172.16.0.220,3260] successful.
Oct 20 18:26:02 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c10d089-eddf-4b2f-a894-90aaa74b5e73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d193baa-c1e3-4910-bfaf-0ce3a0d40d50]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== disconnect_volume: return (385ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:26:02 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-188d56be-29f9-4552-bb8e-f5e9a1cbdd1a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:26:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:26:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7402MB free_disk=25.0584716796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 5b5e15d0-98d8-4f35-98ff-41e922792b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a733ecd9-bafe-4cdd-84ce-b1ae4791b7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6e85e54d-3c59-44fd-8140-15d7e00750de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:26:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:26:08 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:26:08 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:26:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:26:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:26:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:26:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:26:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:26:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:38 user nova-compute[74233]: INFO nova.compute.manager [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attaching volume 2b63cb9d-cc10-4805-a138-dc9918ddff83 to /dev/vdb
Oct 20 18:26:39 user nova-compute[74233]: DEBUG os_brick.utils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b95fad-e6ef-47ee-9513-3a98273724df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6826e-ec7b-4eb1-807b-d673016dee23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6834d2d-ad27-48b1-bd8d-09c02b095fdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a2d52-ef4d-4690-8442-f26165653249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:26:39 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:26:39 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bc29ae-ce65-4df2-986f-7a85eb2989ed]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG os_brick.utils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:26:39 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating existing volume attachment record: df28ff58-1067-49fd-b27c-1607ece6a871 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:26:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-changed-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Refreshing instance network info cache due to event network-changed-87fd02ce-7cca-416a-a82b-58ae33042cef. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:26:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] Acquiring lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:26:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] Acquired lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:26:46 user nova-compute[74233]: DEBUG nova.network.neutron [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Refreshing network info cache for port 87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updated VIF entry in instance network info cache for port 87fd02ce-7cca-416a-a82b-58ae33042cef. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updating instance_info_cache with network_info: [{"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-96343e14-3710-4316-ac82-70a0a22f70f4 req-07984cb9-ed83-45d7-80e5-b29b997e37eb service nova] Releasing lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-changed-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Refreshing instance network info cache due to event network-changed-87fd02ce-7cca-416a-a82b-58ae33042cef. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] Acquiring lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] Acquired lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Refreshing network info cache for port 87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:47 user nova-compute[74233]: INFO nova.compute.manager [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Terminating instance
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updated VIF entry in instance network info cache for port 87fd02ce-7cca-416a-a82b-58ae33042cef. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updating instance_info_cache with network_info: [{"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0b09a1af-8eaf-4869-b942-29f7c313e8c2 req-902af131-aa2b-4b6d-8ea6-5ba9bde0a6d9 service nova] Releasing lock "refresh_cache-6e85e54d-3c59-44fd-8140-15d7e00750de" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ed3a838-f806-4ac9-b5b4-4f982a163bb5 req-d40b936c-1dc5-4fae-b95b-182f8a4c28b7 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-vif-unplugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ed3a838-f806-4ac9-b5b4-4f982a163bb5 req-d40b936c-1dc5-4fae-b95b-182f8a4c28b7 service nova] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ed3a838-f806-4ac9-b5b4-4f982a163bb5 req-d40b936c-1dc5-4fae-b95b-182f8a4c28b7 service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ed3a838-f806-4ac9-b5b4-4f982a163bb5 req-d40b936c-1dc5-4fae-b95b-182f8a4c28b7 service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ed3a838-f806-4ac9-b5b4-4f982a163bb5 req-d40b936c-1dc5-4fae-b95b-182f8a4c28b7 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] No waiting events found dispatching network-vif-unplugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:26:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ed3a838-f806-4ac9-b5b4-4f982a163bb5 req-d40b936c-1dc5-4fae-b95b-182f8a4c28b7 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-vif-unplugged-87fd02ce-7cca-416a-a82b-58ae33042cef for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Instance destroyed successfully.
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'resources' on Instance uuid 6e85e54d-3c59-44fd-8140-15d7e00750de {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1568364489',display_name='tempest-TestVolumeBootPattern-server-1568364489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1568364489',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:25:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-8rxpy1q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:25:38Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=6e85e54d-3c59-44fd-8140-15d7e00750de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "87fd02ce-7cca-416a-a82b-58ae33042cef", "address": "fa:16:3e:c4:b6:f3", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fd02ce-7c", "ovs_interfaceid": "87fd02ce-7cca-416a-a82b-58ae33042cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_vif [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87fd02ce-7c, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afbfc62f-5192-4b87-bc70-32f0bd99a878) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:48 user nova-compute[74233]: INFO os_vif [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b6:f3,bridge_name='br-int',has_traffic_filtering=True,id=87fd02ce-7cca-416a-a82b-58ae33042cef,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fd02ce-7c')
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUICrOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:26:48 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[710970b7-1b24-43f5-bee3-107efe95986d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:26:48 user nova-compute[74233]: No targets found.
Oct 20 18:26:48 user nova-compute[74233]: iSNS:
Oct 20 18:26:48 user nova-compute[74233]: No targets found.
Oct 20 18:26:48 user nova-compute[74233]: STATIC:
Oct 20 18:26:48 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:26:48 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:48 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:48 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:26:48 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:48 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:48 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:26:48 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:48 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:48 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c
Oct 20 18:26:48 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:48 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:48 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:26:48 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:26:48 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:26:48 user nova-compute[74233]: FIRMWARE:
Oct 20 18:26:48 user nova-compute[74233]: No targets found.
Oct 20 18:26:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:26:48 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:26:48 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d86e4-f37b-48de-a584-6d505abb84af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a18e44d-f756-4193-acf2-bba9499c2760]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:26:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:26:48 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:26:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970781bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e45e7-f75f-4977-b5d1-6165fd15e46b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057f39f-78b3-47cc-a1eb-7fbc998c5de3]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c989e-9019-4211-ac74-6a623ffb59ed]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b40a3-4533-4a3a-a3c4-0ead6e5e5d8d]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f660a405-27a6-4052-8532-e8d747947c4f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b997888f-0e3d-4dcc-ac67-a533bafd915d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260]
Oct 20 18:26:48 user nova-compute[74233]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c, portal: 172.16.0.220,3260] successful.
Oct 20 18:26:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1099585-12f0-4d21-83d3-b314017fd66c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116ba0a-80af-4d92-aa24-591613d66fce]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== disconnect_volume: return (390ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:26:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Deleting instance files /opt/stack/data/nova/instances/6e85e54d-3c59-44fd-8140-15d7e00750de_del
Oct 20 18:26:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Deletion of /opt/stack/data/nova/instances/6e85e54d-3c59-44fd-8140-15d7e00750de_del complete
Oct 20 18:26:48 user nova-compute[74233]: INFO nova.compute.manager [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 20 18:26:48 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:26:48 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:26:49 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:26:49 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Took 0.41 seconds to deallocate network for instance.
Oct 20 18:26:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-26685969-c5b0-49b6-b2ff-6c0ac86d4613 req-c07b0aea-2260-434b-a801-38f23c769786 service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-vif-deleted-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:50 user nova-compute[74233]: INFO nova.compute.manager [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Took 0.95 seconds to detach 1 volumes for instance.
Oct 20 18:26:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-e53cc018-6e2e-4880-a1e7-dd8327ada1db req-595d95fa-7e08-4369-af43-f6126326dc3c service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received event network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e53cc018-6e2e-4880-a1e7-dd8327ada1db req-595d95fa-7e08-4369-af43-f6126326dc3c service nova] Acquiring lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e53cc018-6e2e-4880-a1e7-dd8327ada1db req-595d95fa-7e08-4369-af43-f6126326dc3c service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e53cc018-6e2e-4880-a1e7-dd8327ada1db req-595d95fa-7e08-4369-af43-f6126326dc3c service nova] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-e53cc018-6e2e-4880-a1e7-dd8327ada1db req-595d95fa-7e08-4369-af43-f6126326dc3c service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] No waiting events found dispatching network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:26:50 user nova-compute[74233]: WARNING nova.compute.manager [req-e53cc018-6e2e-4880-a1e7-dd8327ada1db req-595d95fa-7e08-4369-af43-f6126326dc3c service nova] [instance: 6e85e54d-3c59-44fd-8140-15d7e00750de] Received unexpected event network-vif-plugged-87fd02ce-7cca-416a-a82b-58ae33042cef for instance with vm_state active and task_state deleting.
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:50 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Deleted allocations for instance 6e85e54d-3c59-44fd-8140-15d7e00750de
Oct 20 18:26:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3c2a9bc-9d98-4dcd-bf8d-26c17871b8c5 tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "6e85e54d-3c59-44fd-8140-15d7e00750de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.177s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:52 user nova-compute[74233]: INFO nova.compute.manager [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Terminating instance
Oct 20 18:26:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-862adba8-c650-42e6-bd26-056f0f88fdcc req-45a4cd10-e85a-4a81-872a-bec3d96e2598 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-vif-unplugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-862adba8-c650-42e6-bd26-056f0f88fdcc req-45a4cd10-e85a-4a81-872a-bec3d96e2598 service nova] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-862adba8-c650-42e6-bd26-056f0f88fdcc req-45a4cd10-e85a-4a81-872a-bec3d96e2598 service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-862adba8-c650-42e6-bd26-056f0f88fdcc req-45a4cd10-e85a-4a81-872a-bec3d96e2598 service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-862adba8-c650-42e6-bd26-056f0f88fdcc req-45a4cd10-e85a-4a81-872a-bec3d96e2598 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] No waiting events found dispatching network-vif-unplugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-862adba8-c650-42e6-bd26-056f0f88fdcc req-45a4cd10-e85a-4a81-872a-bec3d96e2598 service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-vif-unplugged-4c5656c6-8f29-40ac-b14b-f313865a800d for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Instance destroyed successfully.
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lazy-loading 'resources' on Instance uuid 5b5e15d0-98d8-4f35-98ff-41e922792b05 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1807784993',display_name='tempest-TestMinimumBasicScenario-server-1807784993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1807784993',id=30,image_ref='955ca178-1253-4ff1-960e-38f2de9eb9ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4ymyvZ1mWMkdaYXWPsWlaZwrcoMg8ol0ZjRvVMYJEoUhDdZJWuck51LJpHnhDGfzRP46/tAeDS+0xyY6WrqidfS9dO1MfQaq8e+0NwbWMX75QVJJyXBECuES6EBHWV1g==',key_name='tempest-TestMinimumBasicScenario-1257628330',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48d191f70cfa47cfbf249e5a33695689',ramdisk_id='',reservation_id='r-pfj700y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='955ca178-1253-4ff1-960e-38f2de9eb9ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1650546036',owner_user_name='tempest-TestMinimumBasicScenario-1650546036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:21:35Z,user_data=None,user_id='50fe59facf744cf5b860e3b60995c05a',uuid=5b5e15d0-98d8-4f35-98ff-41e922792b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converting VIF {"id": "4c5656c6-8f29-40ac-b14b-f313865a800d", "address": "fa:16:3e:be:4d:be", "network": {"id": "8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1843080349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d191f70cfa47cfbf249e5a33695689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5656c6-8f", "ovs_interfaceid": "4c5656c6-8f29-40ac-b14b-f313865a800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG os_vif [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c5656c6-8f, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f321bc26-eabc-4f84-b6b2-43d8e633884c) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:26:53 user nova-compute[74233]: INFO os_vif [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4d:be,bridge_name='br-int',has_traffic_filtering=True,id=4c5656c6-8f29-40ac-b14b-f313865a800d,network=Network(8bbf0f3d-0fd0-4723-a4cf-3ca479ce0142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c5656c6-8f')
Oct 20 18:26:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Deleting instance files /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05_del
Oct 20 18:26:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Deletion of /opt/stack/data/nova/instances/5b5e15d0-98d8-4f35-98ff-41e922792b05_del complete
Oct 20 18:26:53 user nova-compute[74233]: INFO nova.compute.manager [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 18:26:53 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:26:53 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:26:54 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:26:54 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Took 0.48 seconds to deallocate network for instance.
Oct 20 18:26:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:54 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:26:54 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:26:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:54 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Deleted allocations for instance 5b5e15d0-98d8-4f35-98ff-41e922792b05
Oct 20 18:26:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e36634ab-98f1-4230-897e-3e86c9700e93 tempest-TestMinimumBasicScenario-1650546036 tempest-TestMinimumBasicScenario-1650546036-project-member] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] Acquiring lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:26:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:26:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] Lock "5b5e15d0-98d8-4f35-98ff-41e922792b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:26:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] No waiting events found dispatching network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:26:55 user nova-compute[74233]: WARNING nova.compute.manager [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received unexpected event network-vif-plugged-4c5656c6-8f29-40ac-b14b-f313865a800d for instance with vm_state deleted and task_state None.
Oct 20 18:26:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3b0633d-9e82-4533-9852-7bb91b24eeba req-fed63ce5-bf5c-45b1-83bd-315ea24f213d service nova] [instance: 5b5e15d0-98d8-4f35-98ff-41e922792b05] Received event network-vif-deleted-4c5656c6-8f29-40ac-b14b-f313865a800d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:26:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:27:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:27:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=25.082077026367188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance a733ecd9-bafe-4cdd-84ce-b1ae4791b7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 6d03ff84-b768-404f-a319-dde83c0d334f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:27:07 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:27:08 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:27:08 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:27:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:27:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updating instance_info_cache with network_info: [{"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f8ba938f-246b-41d5-ab0f-30a41d148f1f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:27:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOJnIDpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:27:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:27:11 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:27:11 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bafd3b-fb7b-48bb-aae0-020e9fa21250]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:27:11 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7ed43c-bafb-4bec-85e0-31889f54cfa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83] added
Oct 20 18:27:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f6ab1-1be8-4423-81d1-ca0a7c9ab39d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e51cb-d066-42df-9542-1310cc5e4cf6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOJnIDpL {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOJnIDpL" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe25b4d-d014-40be-ab80-a1fc5985d0de]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOJnIDpL'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b04c42-09eb-499e-91b6-44f86be7ccc4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eee4a3-efbf-400f-af1d-afd29c6b8ac1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0786f177-ae45-4418-b4aa-09549fd746a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260]
Oct 20 18:27:11 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260] successful.
Oct 20 18:27:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaadac0-b0da-468f-9c44-ede8822a7920]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43e7c26-5c1b-4c4f-9d46-d533da1a0992]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:11 user nova-compute[74233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)
Oct 20 18:27:11 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73160c9-34fd-4b5f-a1e6-30ed5f0a9d90]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOJnIDpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:27:12 user nova-compute[74233]: INFO nova.compute.claims [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Claim successful on node user
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.network.neutron [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:27:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.policy [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48d29b4bd2074808898ec96be8e0e471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c9b3d85046f4cf78cd79703b467f80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:27:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Creating image(s)
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "/opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "/opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "/opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26466356130646436', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466356130646436', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.objects.instance [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:27:12 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:27:12 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:27:12 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:27:12 user nova-compute[74233]:   <serial>2b63cb9d-cc10-4805-a138-dc9918ddff83</serial>
Oct 20 18:27:12 user nova-compute[74233]: </disk>
Oct 20 18:27:12 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.249s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk 1073741824" returned: 0 in 0.049s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No VIF found with MAC fa:16:3e:74:9a:63, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.network.neutron [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Successfully created port: b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-868a16f5-ebd6-4318-a149-7c56c659560a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.717s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Cannot resize image /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Ensure instance console log exists: /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.network.neutron [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Successfully updated port: b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquired lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.network.neutron [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.network.neutron [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-changed-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Refreshing instance network info cache due to event network-changed-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:27:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] Acquiring lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.neutron [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updating instance_info_cache with network_info: [{"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Releasing lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Instance network_info: |[{"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] Acquired lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.neutron [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Refreshing network info cache for port b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Start _get_guest_xml network_info=[{"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:27:14 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:27:14 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-103382139',display_name='tempest-VolumesSnapshotTestJSON-instance-103382139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-103382139',id=37,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGzeO0v4jR1FXJqeG6u5W1tuRMJaqwOObk8Mj6bH3PwoflAu7CNMnuTkhfrbM6Y6mIX5R6nI5I86cXVKODunRMNwRMhUbVdN/zqeas5pWkxxdPAUlHpoeMkkYKjLMPxKA==',key_name='tempest-keypair-1762408118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9b3d85046f4cf78cd79703b467f80e',ramdisk_id='',reservation_id='r-ep230ql1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1067753256',owner_user_name='tempest-VolumesSnapshotTestJSON-1067753256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d29b4bd2074808898ec96be8e0e471',uuid=b846b73b-60c6-494f-b016-fccc18b6c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converting VIF {"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.objects.instance [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'pci_devices' on Instance uuid b846b73b-60c6-494f-b016-fccc18b6c15f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:27:14 user nova-compute[74233]:   <uuid>b846b73b-60c6-494f-b016-fccc18b6c15f</uuid>
Oct 20 18:27:14 user nova-compute[74233]:   <name>instance-00000025</name>
Oct 20 18:27:14 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:27:14 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:27:14 user nova-compute[74233]:   <metadata>
Oct 20 18:27:14 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:27:14 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:27:14 user nova-compute[74233]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-103382139</nova:name>
Oct 20 18:27:14 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:27:14</nova:creationTime>
Oct 20 18:27:14 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:27:14 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:27:14 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:27:14 user nova-compute[74233]:       <nova:owner>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:user uuid="48d29b4bd2074808898ec96be8e0e471">tempest-VolumesSnapshotTestJSON-1067753256-project-member</nova:user>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:project uuid="5c9b3d85046f4cf78cd79703b467f80e">tempest-VolumesSnapshotTestJSON-1067753256</nova:project>
Oct 20 18:27:14 user nova-compute[74233]:       </nova:owner>
Oct 20 18:27:14 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:27:14 user nova-compute[74233]:       <nova:ports>
Oct 20 18:27:14 user nova-compute[74233]:         <nova:port uuid="b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92">
Oct 20 18:27:14 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 18:27:14 user nova-compute[74233]:         </nova:port>
Oct 20 18:27:14 user nova-compute[74233]:       </nova:ports>
Oct 20 18:27:14 user nova-compute[74233]:     </nova:instance>
Oct 20 18:27:14 user nova-compute[74233]:   </metadata>
Oct 20 18:27:14 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:27:14 user nova-compute[74233]:     <system>
Oct 20 18:27:14 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:27:14 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:27:14 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:27:14 user nova-compute[74233]:       <entry name="serial">b846b73b-60c6-494f-b016-fccc18b6c15f</entry>
Oct 20 18:27:14 user nova-compute[74233]:       <entry name="uuid">b846b73b-60c6-494f-b016-fccc18b6c15f</entry>
Oct 20 18:27:14 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:27:14 user nova-compute[74233]:     </system>
Oct 20 18:27:14 user nova-compute[74233]:   </sysinfo>
Oct 20 18:27:14 user nova-compute[74233]:   <os>
Oct 20 18:27:14 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:27:14 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:27:14 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:27:14 user nova-compute[74233]:   </os>
Oct 20 18:27:14 user nova-compute[74233]:   <features>
Oct 20 18:27:14 user nova-compute[74233]:     <acpi/>
Oct 20 18:27:14 user nova-compute[74233]:     <apic/>
Oct 20 18:27:14 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:27:14 user nova-compute[74233]:   </features>
Oct 20 18:27:14 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:27:14 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:27:14 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:27:14 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:27:14 user nova-compute[74233]:   </clock>
Oct 20 18:27:14 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:27:14 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:27:14 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:27:14 user nova-compute[74233]:   </cpu>
Oct 20 18:27:14 user nova-compute[74233]:   <devices>
Oct 20 18:27:14 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:27:14 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:27:14 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk"/>
Oct 20 18:27:14 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:27:14 user nova-compute[74233]:     </disk>
Oct 20 18:27:14 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:27:14 user nova-compute[74233]:       <mac address="fa:16:3e:2c:eb:73"/>
Oct 20 18:27:14 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:27:14 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:27:14 user nova-compute[74233]:       <target dev="tapb8a0e54e-1f"/>
Oct 20 18:27:14 user nova-compute[74233]:     </interface>
Oct 20 18:27:14 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:27:14 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/console.log" append="off"/>
Oct 20 18:27:14 user nova-compute[74233]:     </serial>
Oct 20 18:27:14 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:27:14 user nova-compute[74233]:     <video>
Oct 20 18:27:14 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:27:14 user nova-compute[74233]:     </video>
Oct 20 18:27:14 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:27:14 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:27:14 user nova-compute[74233]:     </rng>
Oct 20 18:27:14 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:27:14 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:27:14 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:27:14 user nova-compute[74233]:     </memballoon>
Oct 20 18:27:14 user nova-compute[74233]:   </devices>
Oct 20 18:27:14 user nova-compute[74233]: </domain>
Oct 20 18:27:14 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-103382139',display_name='tempest-VolumesSnapshotTestJSON-instance-103382139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-103382139',id=37,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGzeO0v4jR1FXJqeG6u5W1tuRMJaqwOObk8Mj6bH3PwoflAu7CNMnuTkhfrbM6Y6mIX5R6nI5I86cXVKODunRMNwRMhUbVdN/zqeas5pWkxxdPAUlHpoeMkkYKjLMPxKA==',key_name='tempest-keypair-1762408118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9b3d85046f4cf78cd79703b467f80e',ramdisk_id='',reservation_id='r-ep230ql1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1067753256',owner_user_name='tempest-VolumesSnapshotTestJSON-1067753256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d29b4bd2074808898ec96be8e0e471',uuid=b846b73b-60c6-494f-b016-fccc18b6c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converting VIF {"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG os_vif [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc702c65-50e9-5b8e-9050-34c1e01626bc', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8a0e54e-1f, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8a0e54e-1f, col_values=(('qos', UUID('c8297667-d680-4590-bfdf-89b5ec18ca22')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8a0e54e-1f, col_values=(('external_ids', {'iface-id': 'b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:eb:73', 'vm-uuid': 'b846b73b-60c6-494f-b016-fccc18b6c15f'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:14 user nova-compute[74233]: INFO os_vif [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f')
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No VIF found with MAC fa:16:3e:2c:eb:73, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.neutron [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updated VIF entry in instance network info cache for port b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG nova.network.neutron [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updating instance_info_cache with network_info: [{"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bec927dc-76e5-4191-85b1-0f4bba210885 req-f85bca51-ec00-4e15-a705-aa723e66d786 service nova] Releasing lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:15 user nova-compute[74233]: INFO nova.compute.manager [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Detaching volume 2b63cb9d-cc10-4805-a138-dc9918ddff83
Oct 20 18:27:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:15 user nova-compute[74233]: INFO nova.virt.block_device [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attempting to driver detach volume 2b63cb9d-cc10-4805-a138-dc9918ddff83 from mountpoint /dev/vdb
Oct 20 18:27:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Attempting to detach device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:27:15 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:27:15 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:27:15 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:27:15 user nova-compute[74233]:   <serial>2b63cb9d-cc10-4805-a138-dc9918ddff83</serial>
Oct 20 18:27:15 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:27:15 user nova-compute[74233]: </disk>
Oct 20 18:27:15 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:27:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config.
Oct 20 18:27:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:27:15 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:27:15 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:27:15 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:27:15 user nova-compute[74233]:   <serial>2b63cb9d-cc10-4805-a138-dc9918ddff83</serial>
Oct 20 18:27:15 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:27:15 user nova-compute[74233]: </disk>
Oct 20 18:27:15 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-58d2d38a-88ae-4963-a686-7d7b6be89ecf req-64cb191a-39c1-4d23-9213-d37b886b965d service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-58d2d38a-88ae-4963-a686-7d7b6be89ecf req-64cb191a-39c1-4d23-9213-d37b886b965d service nova] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-58d2d38a-88ae-4963-a686-7d7b6be89ecf req-64cb191a-39c1-4d23-9213-d37b886b965d service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-58d2d38a-88ae-4963-a686-7d7b6be89ecf req-64cb191a-39c1-4d23-9213-d37b886b965d service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-58d2d38a-88ae-4963-a686-7d7b6be89ecf req-64cb191a-39c1-4d23-9213-d37b886b965d service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] No waiting events found dispatching network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:15 user nova-compute[74233]: WARNING nova.compute.manager [req-58d2d38a-88ae-4963-a686-7d7b6be89ecf req-64cb191a-39c1-4d23-9213-d37b886b965d service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received unexpected event network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 for instance with vm_state building and task_state spawning.
Oct 20 18:27:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:27:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-f98f7611-bbe4-42ba-8d06-6a2940e849be req-08d21b70-c9b1-46ad-abba-f39c335ecb00 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f98f7611-bbe4-42ba-8d06-6a2940e849be req-08d21b70-c9b1-46ad-abba-f39c335ecb00 service nova] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f98f7611-bbe4-42ba-8d06-6a2940e849be req-08d21b70-c9b1-46ad-abba-f39c335ecb00 service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f98f7611-bbe4-42ba-8d06-6a2940e849be req-08d21b70-c9b1-46ad-abba-f39c335ecb00 service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-f98f7611-bbe4-42ba-8d06-6a2940e849be req-08d21b70-c9b1-46ad-abba-f39c335ecb00 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] No waiting events found dispatching network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:17 user nova-compute[74233]: WARNING nova.compute.manager [req-f98f7611-bbe4-42ba-8d06-6a2940e849be req-08d21b70-c9b1-46ad-abba-f39c335ecb00 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received unexpected event network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 for instance with vm_state building and task_state spawning.
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:27:18 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Instance spawned successfully.
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:18 user nova-compute[74233]: INFO nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 20 18:27:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:27:18 user nova-compute[74233]: INFO nova.compute.manager [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Took 6.30 seconds to build instance.
Oct 20 18:27:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-29d6f8fc-0b79-4252-acc5-d935a8fdda74 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.400s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:27 user nova-compute[74233]: INFO nova.compute.manager [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Unrescuing
Oct 20 18:27:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'flavor' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-04a2c495-f837-491f-a643-21b4f3dcf404 req-0a7376c7-b884-4a07-b5af-1e6fd256eb97 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-04a2c495-f837-491f-a643-21b4f3dcf404 req-0a7376c7-b884-4a07-b5af-1e6fd256eb97 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-04a2c495-f837-491f-a643-21b4f3dcf404 req-0a7376c7-b884-4a07-b5af-1e6fd256eb97 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-04a2c495-f837-491f-a643-21b4f3dcf404 req-0a7376c7-b884-4a07-b5af-1e6fd256eb97 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-04a2c495-f837-491f-a643-21b4f3dcf404 req-0a7376c7-b884-4a07-b5af-1e6fd256eb97 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:28 user nova-compute[74233]: WARNING nova.compute.manager [req-04a2c495-f837-491f-a643-21b4f3dcf404 req-0a7376c7-b884-4a07-b5af-1e6fd256eb97 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:27:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:28 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance destroyed successfully.
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:30 user nova-compute[74233]: WARNING nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:27:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:30 user nova-compute[74233]: WARNING nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:27:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:30 user nova-compute[74233]: WARNING nova.compute.manager [req-213271f5-a265-470c-8d99-63245c575fc0 req-cd565086-ed56-4783-a525-8cf4eaddd0a6 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 18:27:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:31 user nova-compute[74233]: INFO nova.compute.manager [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Terminating instance
Oct 20 18:27:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-dcd87c51-4921-49b7-8db8-80abb3f6f911 req-eb563304-e6a2-450d-a2af-8d5631893c63 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-dcd87c51-4921-49b7-8db8-80abb3f6f911 req-eb563304-e6a2-450d-a2af-8d5631893c63 service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-dcd87c51-4921-49b7-8db8-80abb3f6f911 req-eb563304-e6a2-450d-a2af-8d5631893c63 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-dcd87c51-4921-49b7-8db8-80abb3f6f911 req-eb563304-e6a2-450d-a2af-8d5631893c63 service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-dcd87c51-4921-49b7-8db8-80abb3f6f911 req-eb563304-e6a2-450d-a2af-8d5631893c63 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:31 user nova-compute[74233]: DEBUG nova.compute.manager [req-dcd87c51-4921-49b7-8db8-80abb3f6f911 req-eb563304-e6a2-450d-a2af-8d5631893c63 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-unplugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:27:31 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Instance destroyed successfully.
Oct 20 18:27:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lazy-loading 'resources' on Instance uuid 6d03ff84-b768-404f-a319-dde83c0d334f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c772c463-8e0f-4e3f-927c-ae18cb019c73 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-906554630',display_name='tempest-ServerActionsTestOtherB-server-906554630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-906554630',id=27,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/x5SfvEpLXmox9siwvji9kYSfHSNQWLvwdx0D5KfpZj+Ac5+Dsrpowg5Z+QLdFWtgBS4cA56Ble6Zv2+RqGEey4dRf3QmhiiNSVtqrBCx5xaYtGbthHGCJGUktecV6w==',key_name='tempest-keypair-85715952',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c98418bca8ed4de094d230072e355984',ramdisk_id='',reservation_id='r-dafwwywn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2120896258',owner_user_name='tempest-ServerActionsTestOtherB-2120896258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5560a7c568e54a76b94eb889229c78a5',uuid=6d03ff84-b768-404f-a319-dde83c0d334f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converting VIF {"id": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "address": "fa:16:3e:8f:cb:6c", "network": {"id": "c362da61-da74-4082-9b75-f31cef7f4b12", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1514054828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c98418bca8ed4de094d230072e355984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4ef092-a7", "ovs_interfaceid": "6b4ef092-a79c-40e6-98a2-e6a45f6044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_vif [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b4ef092-a7, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d483b93a-adf4-4597-9312-2aa511f7e72e) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:32 user nova-compute[74233]: INFO os_vif [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cb:6c,bridge_name='br-int',has_traffic_filtering=True,id=6b4ef092-a79c-40e6-98a2-e6a45f6044c3,network=Network(c362da61-da74-4082-9b75-f31cef7f4b12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4ef092-a7')
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmEGTip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:27:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d5797f-372f-4d7f-a6b4-bbdc192f6af6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:27:32 user nova-compute[74233]: No targets found.
Oct 20 18:27:32 user nova-compute[74233]: iSNS:
Oct 20 18:27:32 user nova-compute[74233]: No targets found.
Oct 20 18:27:32 user nova-compute[74233]: STATIC:
Oct 20 18:27:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:27:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:27:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668
Oct 20 18:27:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83
Oct 20 18:27:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:32 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:27:32 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:32 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:32 user nova-compute[74233]: FIRMWARE:
Oct 20 18:27:32 user nova-compute[74233]: No targets found.
Oct 20 18:27:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:27:32 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:27:32 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a31cec-c967-4a47-8677-00658233f56d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd5c79-5452-441e-8054-81768d3bcc99]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)
Oct 20 18:27:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:32 user nova-compute[74233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)
Oct 20 18:27:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801fcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[88047988-14f1-41b1-9df8-641d13dccaa3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc68cf-3c4e-4051-9625-013e1a98704d]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0586fe-179e-46f1-b42b-19bee7df35c8]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e06b99-7248-465f-8ab1-8ae6920e8dc6]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21601dcc-4236-40c8-abbd-3602a1c8ff67]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1faee6-fcdf-4dac-bbfe-18d6a71b44d6]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260]
Oct 20 18:27:32 user nova-compute[74233]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668, portal: 172.16.0.220,3260] successful.
Oct 20 18:27:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0489f953-4e2a-46cc-8a04-b8ffe75a5668 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[36191302-5dde-4326-bbc8-3b6f027c9e75]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] <== disconnect_volume: return (337ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:27:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Deleting instance files /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f_del
Oct 20 18:27:32 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Deletion of /opt/stack/data/nova/instances/6d03ff84-b768-404f-a319-dde83c0d334f_del complete
Oct 20 18:27:32 user nova-compute[74233]: INFO nova.compute.manager [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 20 18:27:32 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:27:32 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:27:33 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:33 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Took 0.72 seconds to deallocate network for instance.
Oct 20 18:27:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-810b7e86-3c2a-437c-8a3d-96b7fc56b5a3 req-3097b68f-3624-4614-96ed-4a3bb068ff12 service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-deleted-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-ac32349a-4d57-4857-8c69-ce639132b9e2 req-c5381714-c608-4875-87a2-b0ea60bcb68c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ac32349a-4d57-4857-8c69-ce639132b9e2 req-c5381714-c608-4875-87a2-b0ea60bcb68c service nova] Acquiring lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ac32349a-4d57-4857-8c69-ce639132b9e2 req-c5381714-c608-4875-87a2-b0ea60bcb68c service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ac32349a-4d57-4857-8c69-ce639132b9e2 req-c5381714-c608-4875-87a2-b0ea60bcb68c service nova] Lock "6d03ff84-b768-404f-a319-dde83c0d334f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:33 user nova-compute[74233]: DEBUG nova.compute.manager [req-ac32349a-4d57-4857-8c69-ce639132b9e2 req-c5381714-c608-4875-87a2-b0ea60bcb68c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] No waiting events found dispatching network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:33 user nova-compute[74233]: WARNING nova.compute.manager [req-ac32349a-4d57-4857-8c69-ce639132b9e2 req-c5381714-c608-4875-87a2-b0ea60bcb68c service nova] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Received unexpected event network-vif-plugged-6b4ef092-a79c-40e6-98a2-e6a45f6044c3 for instance with vm_state active and task_state deleting.
Oct 20 18:27:34 user nova-compute[74233]: INFO nova.compute.manager [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] [instance: 6d03ff84-b768-404f-a319-dde83c0d334f] Took 1.08 seconds to detach 1 volumes for instance.
Oct 20 18:27:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:34 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:27:34 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:27:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:34 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Deleted allocations for instance 6d03ff84-b768-404f-a319-dde83c0d334f
Oct 20 18:27:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-51037efa-15de-401a-9117-34fcfdfb747c tempest-ServerActionsTestOtherB-2120896258 tempest-ServerActionsTestOtherB-2120896258-project-member] Lock "6d03ff84-b768-404f-a319-dde83c0d334f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.652s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 is timed out.
Oct 20 18:27:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config.
Oct 20 18:27:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOJnIDpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:27:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fbfddf-a597-4eb1-86f3-7b4418ed52b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:27:36 user nova-compute[74233]: No targets found.
Oct 20 18:27:36 user nova-compute[74233]: iSNS:
Oct 20 18:27:36 user nova-compute[74233]: No targets found.
Oct 20 18:27:36 user nova-compute[74233]: STATIC:
Oct 20 18:27:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:27:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:27:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83
Oct 20 18:27:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:27:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:27:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:27:36 user nova-compute[74233]: FIRMWARE:
Oct 20 18:27:36 user nova-compute[74233]: No targets found.
Oct 20 18:27:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:27:36 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:27:36 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7a37d8-746e-48dc-930e-7c6d5a8a54f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae68dc-a6c5-4840-b10b-a3c65a4f7370]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:36 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:36 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:36 user nova-compute[74233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)
Oct 20 18:27:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:27:36 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:27:36 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:27:36 user nova-compute[74233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 (non-flash)
Oct 20 18:27:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801fda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[495943a1-b7e0-4ece-8d18-b339a1d5b312]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52543108-f78a-43af-9dc0-4ddfb188c106]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a6744-6c11-4688-a85a-9c7c894abc6c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a9f922-cab9-4817-b8fd-065835f3737b]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd711b0a-e0a5-436b-8bec-87e43619bed9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bbd53e-b1c2-4e06-9d12-f2425235233e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260]
Oct 20 18:27:36 user nova-compute[74233]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83, portal: 172.16.0.220,3260] successful.
Oct 20 18:27:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b63cb9d-cc10-4805-a138-dc9918ddff83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64805c4-7328-48be-a928-ce26afc1d860]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== disconnect_volume: return (348ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:27:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:27:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b505200-387d-41cb-a63e-4ff8e915110a tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.964s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:27:44 user nova-compute[74233]: INFO nova.compute.claims [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Claim successful on node user
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.network.neutron [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:27:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:27:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:27:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Creating image(s)
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "/opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "/opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "/opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.policy [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f118f66b77324814b79c81c27b06a044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448d5ec959db41acaaae6316c072a7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk 1073741824" returned: 0 in 0.062s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.222s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Cannot resize image /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Ensure instance console log exists: /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Successfully created port: fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:27:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Successfully updated port: fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:27:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "refresh_cache-42907c0b-8e5a-43d8-9898-a78f47f4bfed" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquired lock "refresh_cache-42907c0b-8e5a-43d8-9898-a78f47f4bfed" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-changed-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Refreshing instance network info cache due to event network-changed-fc78207e-f23d-4e43-86c4-d509514eae63. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] Acquiring lock "refresh_cache-42907c0b-8e5a-43d8-9898-a78f47f4bfed" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Updating instance_info_cache with network_info: [{"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Releasing lock "refresh_cache-42907c0b-8e5a-43d8-9898-a78f47f4bfed" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Instance network_info: |[{"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] Acquired lock "refresh_cache-42907c0b-8e5a-43d8-9898-a78f47f4bfed" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Refreshing network info cache for port fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Start _get_guest_xml network_info=[{"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:27:47 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:27:47 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1277829570',display_name='tempest-VolumesNegativeTest-instance-1277829570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1277829570',id=38,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='448d5ec959db41acaaae6316c072a7be',ramdisk_id='',reservation_id='r-cm2tjivw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-968772716',owner_user_name='tempest-VolumesNegativeTest-968772716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:27:45Z,user_data=None,user_id='f118f66b77324814b79c81c27b06a044',uuid=42907c0b-8e5a-43d8-9898-a78f47f4bfed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Converting VIF {"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lazy-loading 'pci_devices' on Instance uuid 42907c0b-8e5a-43d8-9898-a78f47f4bfed {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:27:47 user nova-compute[74233]:   <uuid>42907c0b-8e5a-43d8-9898-a78f47f4bfed</uuid>
Oct 20 18:27:47 user nova-compute[74233]:   <name>instance-00000026</name>
Oct 20 18:27:47 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:27:47 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:27:47 user nova-compute[74233]:   <metadata>
Oct 20 18:27:47 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:27:47 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:27:47 user nova-compute[74233]:       <nova:name>tempest-VolumesNegativeTest-instance-1277829570</nova:name>
Oct 20 18:27:47 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:27:47</nova:creationTime>
Oct 20 18:27:47 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:27:47 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:27:47 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:27:47 user nova-compute[74233]:       <nova:owner>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:user uuid="f118f66b77324814b79c81c27b06a044">tempest-VolumesNegativeTest-968772716-project-member</nova:user>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:project uuid="448d5ec959db41acaaae6316c072a7be">tempest-VolumesNegativeTest-968772716</nova:project>
Oct 20 18:27:47 user nova-compute[74233]:       </nova:owner>
Oct 20 18:27:47 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:27:47 user nova-compute[74233]:       <nova:ports>
Oct 20 18:27:47 user nova-compute[74233]:         <nova:port uuid="fc78207e-f23d-4e43-86c4-d509514eae63">
Oct 20 18:27:47 user nova-compute[74233]:           <nova:ip type="fixed" address="192.168.233.108" ipVersion="4"/>
Oct 20 18:27:47 user nova-compute[74233]:         </nova:port>
Oct 20 18:27:47 user nova-compute[74233]:       </nova:ports>
Oct 20 18:27:47 user nova-compute[74233]:     </nova:instance>
Oct 20 18:27:47 user nova-compute[74233]:   </metadata>
Oct 20 18:27:47 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:27:47 user nova-compute[74233]:     <system>
Oct 20 18:27:47 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:27:47 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:27:47 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:27:47 user nova-compute[74233]:       <entry name="serial">42907c0b-8e5a-43d8-9898-a78f47f4bfed</entry>
Oct 20 18:27:47 user nova-compute[74233]:       <entry name="uuid">42907c0b-8e5a-43d8-9898-a78f47f4bfed</entry>
Oct 20 18:27:47 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:27:47 user nova-compute[74233]:     </system>
Oct 20 18:27:47 user nova-compute[74233]:   </sysinfo>
Oct 20 18:27:47 user nova-compute[74233]:   <os>
Oct 20 18:27:47 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:27:47 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:27:47 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:27:47 user nova-compute[74233]:   </os>
Oct 20 18:27:47 user nova-compute[74233]:   <features>
Oct 20 18:27:47 user nova-compute[74233]:     <acpi/>
Oct 20 18:27:47 user nova-compute[74233]:     <apic/>
Oct 20 18:27:47 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:27:47 user nova-compute[74233]:   </features>
Oct 20 18:27:47 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:27:47 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:27:47 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:27:47 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:27:47 user nova-compute[74233]:   </clock>
Oct 20 18:27:47 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:27:47 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:27:47 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:27:47 user nova-compute[74233]:   </cpu>
Oct 20 18:27:47 user nova-compute[74233]:   <devices>
Oct 20 18:27:47 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:27:47 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:27:47 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk"/>
Oct 20 18:27:47 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:27:47 user nova-compute[74233]:     </disk>
Oct 20 18:27:47 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:27:47 user nova-compute[74233]:       <mac address="fa:16:3e:0f:44:0d"/>
Oct 20 18:27:47 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:27:47 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:27:47 user nova-compute[74233]:       <target dev="tapfc78207e-f2"/>
Oct 20 18:27:47 user nova-compute[74233]:     </interface>
Oct 20 18:27:47 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:27:47 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/console.log" append="off"/>
Oct 20 18:27:47 user nova-compute[74233]:     </serial>
Oct 20 18:27:47 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:27:47 user nova-compute[74233]:     <video>
Oct 20 18:27:47 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:27:47 user nova-compute[74233]:     </video>
Oct 20 18:27:47 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:27:47 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:27:47 user nova-compute[74233]:     </rng>
Oct 20 18:27:47 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:27:47 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:27:47 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:27:47 user nova-compute[74233]:     </memballoon>
Oct 20 18:27:47 user nova-compute[74233]:   </devices>
Oct 20 18:27:47 user nova-compute[74233]: </domain>
Oct 20 18:27:47 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1277829570',display_name='tempest-VolumesNegativeTest-instance-1277829570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1277829570',id=38,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='448d5ec959db41acaaae6316c072a7be',ramdisk_id='',reservation_id='r-cm2tjivw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-968772716',owner_user_name='tempest-VolumesNegativeTest-968772716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:27:45Z,user_data=None,user_id='f118f66b77324814b79c81c27b06a044',uuid=42907c0b-8e5a-43d8-9898-a78f47f4bfed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Converting VIF {"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG os_vif [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd1755be-af62-56e7-85ab-251044cbcd00', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc78207e-f2, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc78207e-f2, col_values=(('qos', UUID('389bf9b1-0040-4296-82a8-745f0d966fe1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc78207e-f2, col_values=(('external_ids', {'iface-id': 'fc78207e-f23d-4e43-86c4-d509514eae63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:44:0d', 'vm-uuid': '42907c0b-8e5a-43d8-9898-a78f47f4bfed'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:47 user nova-compute[74233]: INFO os_vif [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2')
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] No VIF found with MAC fa:16:3e:0f:44:0d, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Updated VIF entry in instance network info cache for port fc78207e-f23d-4e43-86c4-d509514eae63. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG nova.network.neutron [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Updating instance_info_cache with network_info: [{"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-997572db-cbdc-45f5-946b-68a863252a83 req-dc993f3b-01f9-4542-88c2-c113250eb333 service nova] Releasing lock "refresh_cache-42907c0b-8e5a-43d8-9898-a78f47f4bfed" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-9d1185fe-15ee-4117-b4e6-297142f0d592 req-39c81c0e-d36f-4e6b-9dc4-d73ec8fbb494 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9d1185fe-15ee-4117-b4e6-297142f0d592 req-39c81c0e-d36f-4e6b-9dc4-d73ec8fbb494 service nova] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9d1185fe-15ee-4117-b4e6-297142f0d592 req-39c81c0e-d36f-4e6b-9dc4-d73ec8fbb494 service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9d1185fe-15ee-4117-b4e6-297142f0d592 req-39c81c0e-d36f-4e6b-9dc4-d73ec8fbb494 service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-9d1185fe-15ee-4117-b4e6-297142f0d592 req-39c81c0e-d36f-4e6b-9dc4-d73ec8fbb494 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] No waiting events found dispatching network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:49 user nova-compute[74233]: WARNING nova.compute.manager [req-9d1185fe-15ee-4117-b4e6-297142f0d592 req-39c81c0e-d36f-4e6b-9dc4-d73ec8fbb494 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received unexpected event network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 for instance with vm_state building and task_state spawning.
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:27:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Instance spawned successfully.
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-ecfc3d57-043a-46e4-a89d-39eb0afbab69 req-a606115c-ca44-4413-8eda-5f408f485345 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ecfc3d57-043a-46e4-a89d-39eb0afbab69 req-a606115c-ca44-4413-8eda-5f408f485345 service nova] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ecfc3d57-043a-46e4-a89d-39eb0afbab69 req-a606115c-ca44-4413-8eda-5f408f485345 service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ecfc3d57-043a-46e4-a89d-39eb0afbab69 req-a606115c-ca44-4413-8eda-5f408f485345 service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-ecfc3d57-043a-46e4-a89d-39eb0afbab69 req-a606115c-ca44-4413-8eda-5f408f485345 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] No waiting events found dispatching network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:51 user nova-compute[74233]: WARNING nova.compute.manager [req-ecfc3d57-043a-46e4-a89d-39eb0afbab69 req-a606115c-ca44-4413-8eda-5f408f485345 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received unexpected event network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 for instance with vm_state building and task_state spawning.
Oct 20 18:27:51 user nova-compute[74233]: INFO nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 20 18:27:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:27:51 user nova-compute[74233]: INFO nova.compute.manager [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Took 7.21 seconds to build instance.
Oct 20 18:27:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a54d11c8-0a44-4127-b342-3124e35b3afc tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.303s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-changed-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Refreshing instance network info cache due to event network-changed-56807116-38ed-4b60-9867-b9964dcbb67d. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:27:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] Acquiring lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:27:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] Acquired lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:27:58 user nova-compute[74233]: DEBUG nova.network.neutron [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Refreshing network info cache for port 56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:59 user nova-compute[74233]: INFO nova.compute.manager [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Terminating instance
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-1f0ccc1e-63e6-4a8f-8cd4-693b4e04d40a req-4f2e8106-affb-4886-b393-b97d199bd17f service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-vif-unplugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1f0ccc1e-63e6-4a8f-8cd4-693b4e04d40a req-4f2e8106-affb-4886-b393-b97d199bd17f service nova] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1f0ccc1e-63e6-4a8f-8cd4-693b4e04d40a req-4f2e8106-affb-4886-b393-b97d199bd17f service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1f0ccc1e-63e6-4a8f-8cd4-693b4e04d40a req-4f2e8106-affb-4886-b393-b97d199bd17f service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-1f0ccc1e-63e6-4a8f-8cd4-693b4e04d40a req-4f2e8106-affb-4886-b393-b97d199bd17f service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] No waiting events found dispatching network-vif-unplugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-1f0ccc1e-63e6-4a8f-8cd4-693b4e04d40a req-4f2e8106-affb-4886-b393-b97d199bd17f service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-vif-unplugged-56807116-38ed-4b60-9867-b9964dcbb67d for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updated VIF entry in instance network info cache for port 56807116-38ed-4b60-9867-b9964dcbb67d. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.network.neutron [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updating instance_info_cache with network_info: [{"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9cdad425-3be2-4fa2-99ec-4951f867aa67 req-d9eb7c6b-e185-49a1-a51d-2d851b256122 service nova] Releasing lock "refresh_cache-a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:27:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Instance destroyed successfully.
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.objects.instance [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lazy-loading 'resources' on Instance uuid a733ecd9-bafe-4cdd-84ce-b1ae4791b7da {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-799439366',display_name='tempest-TestVolumeBootPattern-server-799439366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-799439366',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuXYBXC1siEQrxGS18Ll/n/tqMZ5Td7AKWG2wIROOBWuoF26QD8WcCEIDFXdt2Pal6WYUkjCfzuwXbn+YyT4XvwbGscNDGRq2vzWWOV5GN5SA6BvPenut7Noza5siZgSA==',key_name='tempest-TestVolumeBootPattern-537232509',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b592b103d8084815bf6d3132c1215feb',ramdisk_id='',reservation_id='r-lzhz0vef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2006411708',owner_user_name='tempest-TestVolumeBootPattern-2006411708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:23:27Z,user_data=None,user_id='10447188fbd74b18ba64fc8e64d267c6',uuid=a733ecd9-bafe-4cdd-84ce-b1ae4791b7da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converting VIF {"id": "56807116-38ed-4b60-9867-b9964dcbb67d", "address": "fa:16:3e:6a:1d:9e", "network": {"id": "3d6a9a1f-65c2-45a3-9438-1511cd69e952", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-833103504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b592b103d8084815bf6d3132c1215feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56807116-38", "ovs_interfaceid": "56807116-38ed-4b60-9867-b9964dcbb67d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:27:59 user nova-compute[74233]: DEBUG os_vif [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56807116-38, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2844c1e1-f7c9-4721-bb75-ab8816cc86ff) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:00 user nova-compute[74233]: INFO os_vif [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=56807116-38ed-4b60-9867-b9964dcbb67d,network=Network(3d6a9a1f-65c2-45a3-9438-1511cd69e952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56807116-38')
Oct 20 18:28:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZOVJFyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:28:00 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5eccd-efe0-4e37-a98f-560e999eb872]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:28:00 user nova-compute[74233]: No targets found.
Oct 20 18:28:00 user nova-compute[74233]: iSNS:
Oct 20 18:28:00 user nova-compute[74233]: No targets found.
Oct 20 18:28:00 user nova-compute[74233]: STATIC:
Oct 20 18:28:00 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:28:00 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:00 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:00 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2
Oct 20 18:28:00 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:00 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:00 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:28:00 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:00 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:00 user nova-compute[74233]: FIRMWARE:
Oct 20 18:28:00 user nova-compute[74233]: No targets found.
Oct 20 18:28:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:28:00 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:28:00 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b0d64e-f84e-4797-a5ea-90480dee85d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[89151e20-4d5d-473a-95ee-bf54864b3c98]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:28:00 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:00 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 (non-flash)
Oct 20 18:28:00 user nova-compute[74233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:00 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970780af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2'): ({'sdd'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Removing single pathed devices sdd {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e26224-b32b-4252-b3c1-018c6525db5f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ba34c2-5628-47a5-98bb-b512d4cc4048]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Flushing IO for device /dev/sdd {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8f3a8-1cfe-4cf4-a426-f8c2fdb0fb45]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac24eb0-c0db-43a0-abc3-0a2cea949464]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] SCSI volumes sdd have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a4c07-70ad-4680-b401-3c65f6e1dfb0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d4b6ae-1cba-4669-91a8-231fdfe96d35]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260]
Oct 20 18:28:00 user nova-compute[74233]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2, portal: 172.16.0.220,3260] successful.
Oct 20 18:28:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78618bd9-1c8d-4076-a12e-651178361bf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5c35b-03a2-4d59-a867-014a06cb3a3f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] <== disconnect_volume: return (369ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:28:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Deleting instance files /opt/stack/data/nova/instances/a733ecd9-bafe-4cdd-84ce-b1ae4791b7da_del
Oct 20 18:28:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Deletion of /opt/stack/data/nova/instances/a733ecd9-bafe-4cdd-84ce-b1ae4791b7da_del complete
Oct 20 18:28:00 user nova-compute[74233]: INFO nova.compute.manager [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 20 18:28:00 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:00 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:28:00 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Took 0.43 seconds to deallocate network for instance.
Oct 20 18:28:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-e889edd6-6ce1-4543-91ba-77c257608878 req-1933994d-073f-4074-aa9e-f78c2c642abe service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-vif-deleted-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9255f66-b47f-4686-bc57-b15eb090d634 req-dee502b7-fd0f-44ac-8224-d234fcd954f8 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received event network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9255f66-b47f-4686-bc57-b15eb090d634 req-dee502b7-fd0f-44ac-8224-d234fcd954f8 service nova] Acquiring lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9255f66-b47f-4686-bc57-b15eb090d634 req-dee502b7-fd0f-44ac-8224-d234fcd954f8 service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f9255f66-b47f-4686-bc57-b15eb090d634 req-dee502b7-fd0f-44ac-8224-d234fcd954f8 service nova] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-f9255f66-b47f-4686-bc57-b15eb090d634 req-dee502b7-fd0f-44ac-8224-d234fcd954f8 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] No waiting events found dispatching network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:28:01 user nova-compute[74233]: WARNING nova.compute.manager [req-f9255f66-b47f-4686-bc57-b15eb090d634 req-dee502b7-fd0f-44ac-8224-d234fcd954f8 service nova] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Received unexpected event network-vif-plugged-56807116-38ed-4b60-9867-b9964dcbb67d for instance with vm_state active and task_state deleting.
Oct 20 18:28:01 user nova-compute[74233]: INFO nova.compute.manager [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] [instance: a733ecd9-bafe-4cdd-84ce-b1ae4791b7da] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 18:28:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:01 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:02 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:28:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:28:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:02 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Deleted allocations for instance a733ecd9-bafe-4cdd-84ce-b1ae4791b7da
Oct 20 18:28:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-19c44db1-bcd1-44a4-ae24-c3f36ddb129a tempest-TestVolumeBootPattern-2006411708 tempest-TestVolumeBootPattern-2006411708-project-member] Lock "a733ecd9-bafe-4cdd-84ce-b1ae4791b7da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.161s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:28:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:28:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:28:07 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:28:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=25.107097625732422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance b846b73b-60c6-494f-b016-fccc18b6c15f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 42907c0b-8e5a-43d8-9898-a78f47f4bfed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:28:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:28:09 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:10 user nova-compute[74233]: INFO nova.compute.manager [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Detaching volume fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:28:10 user nova-compute[74233]: INFO nova.virt.block_device [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Attempting to driver detach volume fa89c49c-d30e-4c1a-9a6a-c725b598c62b from mountpoint /dev/vdb
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Attempting to detach device vdb from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:28:10 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:28:10 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:28:10 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:28:10 user nova-compute[74233]:   <serial>fa89c49c-d30e-4c1a-9a6a-c725b598c62b</serial>
Oct 20 18:28:10 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 18:28:10 user nova-compute[74233]: </disk>
Oct 20 18:28:10 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:28:10 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully detached device vdb from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 from the persistent domain config.
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:28:10 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:28:10 user nova-compute[74233]:   <source dev="/dev/sdh"/>
Oct 20 18:28:10 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:28:10 user nova-compute[74233]:   <serial>fa89c49c-d30e-4c1a-9a6a-c725b598c62b</serial>
Oct 20 18:28:10 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 18:28:10 user nova-compute[74233]: </disk>
Oct 20 18:28:10 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:28:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:12 user nova-compute[74233]: INFO nova.compute.manager [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attaching volume 4f8efab0-74e7-4c4c-8e3e-928200c27bcc to /dev/vdb
Oct 20 18:28:12 user nova-compute[74233]: DEBUG os_brick.utils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f138451-43ca-4d85-a38a-df709977b6fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0889d89c-0bdb-4944-bb75-1984e57523be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[952999fd-bbad-4c26-8c06-a4b7cde708c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ffbc12-a820-4f9f-8359-8f59252ff609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:28:12 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:28:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d558db8-ce52-4e35-9b5a-6d61526cc70c]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG os_brick.utils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:28:12 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating existing volume attachment record: 484c62a6-f1c2-459d-94f0-3648af79ec9d {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:28:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZUjnOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:28:29 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:28:29 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:28:29 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4d597-7cf2-4f8b-b6b0-e4a8bd72af7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:28:29 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe4a9c1-e753-4fb4-ba94-0b8c35bafaee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc] added
Oct 20 18:28:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6562ccf-b14a-480f-bb87-63394152b662]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be687a8-516a-4930-bd4e-578d84479560]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkZUjnOp {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkZUjnOp" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bd9720-5a1d-476a-9517-db2b9e81d40d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkZUjnOp'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13571c-8c63-4a67-897f-e8da7668ac63]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a17256b-b9d3-4ac4-8dfb-b445d1211a65]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:29 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:29 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[652db414-16df-4e6d-ab71-eb39e7c03137]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260]
Oct 20 18:28:29 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260] successful.
Oct 20 18:28:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c3559-c465-442d-ac29-5b7c4221aa57]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71772e-d19e-4c56-a8f8-f6b44ffe67b2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:29 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:29 user nova-compute[74233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)
Oct 20 18:28:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:29 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:29 user nova-compute[74233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)
Oct 20 18:28:29 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:28:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:30 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:30 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a3098-e5fb-408f-8cee-23a29de4e56b]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:30 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:28:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZUjnOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:28:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 is timed out.
Oct 20 18:28:30 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully detached device vdb from instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 from the live domain config.
Oct 20 18:28:30 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:28:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZpOvAqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:28:30 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:28:30 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26364636362663436', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364636362663436', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.159s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.objects.instance [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f994f-9f28-4fed-86b4-c76b108aeb00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:28:31 user nova-compute[74233]: No targets found.
Oct 20 18:28:31 user nova-compute[74233]: iSNS:
Oct 20 18:28:31 user nova-compute[74233]: No targets found.
Oct 20 18:28:31 user nova-compute[74233]: STATIC:
Oct 20 18:28:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:28:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc
Oct 20 18:28:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:31 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b
Oct 20 18:28:31 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:31 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:31 user nova-compute[74233]: FIRMWARE:
Oct 20 18:28:31 user nova-compute[74233]: No targets found.
Oct 20 18:28:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:28:31 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:28:31 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:28:31 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:28:31 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:28:31 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:28:31 user nova-compute[74233]:   <serial>4f8efab0-74e7-4c4c-8e3e-928200c27bcc</serial>
Oct 20 18:28:31 user nova-compute[74233]: </disk>
Oct 20 18:28:31 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e655dd-7cd4-4950-902a-c9366e712a91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd21bca6-ab44-4503-8641-360a543c8237]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:31 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:31 user nova-compute[74233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)
Oct 20 18:28:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b (non-flash)
Oct 20 18:28:31 user nova-compute[74233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:31 user nova-compute[74233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)
Oct 20 18:28:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801fd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b'): ({'sdh'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Removing single pathed devices sdh {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a336bd9b-092a-470e-be28-40fd8fe859ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1781973-a449-4b4e-aebe-975e6b0a9f55]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flushing IO for device /dev/sdh {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e65f319-e79a-4fa4-b154-a7ebb9cc759e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d335463b-b8f9-4494-a134-54189b00d0b3]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] SCSI volumes sdh have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af83248-4937-4003-b75c-45005daa35cc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c064b56-aec2-4dff-baa6-989f142fe38f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260]
Oct 20 18:28:31 user nova-compute[74233]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b, portal: 172.16.0.220,3260] successful.
Oct 20 18:28:31 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa89c49c-d30e-4c1a-9a6a-c725b598c62b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e57bf-0d0a-4901-b67e-11d4771cb777]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== disconnect_volume: return (470ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No VIF found with MAC fa:16:3e:74:9a:63, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:28:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-08e09ebf-88f9-42ed-9ecb-d09649eb1989 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.471s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:32 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'flavor' on Instance uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:28:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a684c2f1-d9c2-4549-84b6-468d92c0ef9a tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.164s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:34 user nova-compute[74233]: INFO nova.compute.manager [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Detaching volume 4f8efab0-74e7-4c4c-8e3e-928200c27bcc
Oct 20 18:28:34 user nova-compute[74233]: INFO nova.virt.block_device [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attempting to driver detach volume 4f8efab0-74e7-4c4c-8e3e-928200c27bcc from mountpoint /dev/vdb
Oct 20 18:28:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Attempting to detach device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:28:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:28:34 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:28:34 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:28:34 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:28:34 user nova-compute[74233]:   <serial>4f8efab0-74e7-4c4c-8e3e-928200c27bcc</serial>
Oct 20 18:28:34 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:28:34 user nova-compute[74233]: </disk>
Oct 20 18:28:34 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:28:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config.
Oct 20 18:28:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:28:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:28:34 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:28:34 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:28:34 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:28:34 user nova-compute[74233]:   <serial>4f8efab0-74e7-4c4c-8e3e-928200c27bcc</serial>
Oct 20 18:28:34 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:28:34 user nova-compute[74233]: </disk>
Oct 20 18:28:34 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:28:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:28:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:28:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:28:52 user nova-compute[74233]: INFO nova.compute.claims [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Claim successful on node user
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:28:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.policy [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435b9a61a87b4568907c0111eb303002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbc79b631448f39eb01b0034200e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:28:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Creating image(s)
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "/opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "/opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "/opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.203s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk 1073741824" returned: 0 in 0.060s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.205s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Successfully created port: c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Cannot resize image /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Ensure instance console log exists: /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:54 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 is timed out.
Oct 20 18:28:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config.
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZUjnOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:28:54 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca15118-4248-4dc9-9dd3-7a4769454ef0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:28:54 user nova-compute[74233]: No targets found.
Oct 20 18:28:54 user nova-compute[74233]: iSNS:
Oct 20 18:28:54 user nova-compute[74233]: No targets found.
Oct 20 18:28:54 user nova-compute[74233]: STATIC:
Oct 20 18:28:54 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:28:54 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:54 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:54 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc
Oct 20 18:28:54 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:28:54 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:28:54 user nova-compute[74233]: FIRMWARE:
Oct 20 18:28:54 user nova-compute[74233]: No targets found.
Oct 20 18:28:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:28:54 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:28:54 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb4bdd6-fe52-45dc-b4ce-c056f54c4cf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6d5718-a65b-472f-b590-9b8f1f8ba9cd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:54 user nova-compute[74233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)
Oct 20 18:28:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:28:54 user nova-compute[74233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc (non-flash)
Oct 20 18:28:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970608160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Successfully updated port: c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7ee7f-f1c6-4131-a45b-a0e9aa27c8a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "refresh_cache-68ef0023-a3cc-4441-8a7b-2cab2436f5d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquired lock "refresh_cache-68ef0023-a3cc-4441-8a7b-2cab2436f5d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8538b390-b690-4266-b81c-ab90fd073d46]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-changed-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Refreshing instance network info cache due to event network-changed-c77dedf5-6cfe-419a-b050-3759e6bce832. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] Acquiring lock "refresh_cache-68ef0023-a3cc-4441-8a7b-2cab2436f5d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa9cd40-01ff-485b-84cf-dc0a27e4add9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2bbb7-3d56-49cd-b7ba-300f5d94ad0c]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:28:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a213eb-b27b-4d7f-8f09-a5d9278b409c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688dc35-d422-4b1a-a3f1-6088589fc52f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260]
Oct 20 18:28:55 user nova-compute[74233]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc, portal: 172.16.0.220,3260] successful.
Oct 20 18:28:55 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f8efab0-74e7-4c4c-8e3e-928200c27bcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d27064b-ddd7-4ebe-be00-95f5d1119d8d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== disconnect_volume: return (319ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.neutron [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Updating instance_info_cache with network_info: [{"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Releasing lock "refresh_cache-68ef0023-a3cc-4441-8a7b-2cab2436f5d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Instance network_info: |[{"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] Acquired lock "refresh_cache-68ef0023-a3cc-4441-8a7b-2cab2436f5d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.neutron [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Refreshing network info cache for port c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Start _get_guest_xml network_info=[{"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:28:55 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:28:55 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1635686731',display_name='tempest-VolumesActionsTest-instance-1635686731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1635686731',id=39,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14cbc79b631448f39eb01b0034200e32',ramdisk_id='',reservation_id='r-3i84bhpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-385103950',owner_user_name='tempest-VolumesActionsTest-385103950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:28:53Z,user_data=None,user_id='435b9a61a87b4568907c0111eb303002',uuid=68ef0023-a3cc-4441-8a7b-2cab2436f5d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Converting VIF {"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lazy-loading 'pci_devices' on Instance uuid 68ef0023-a3cc-4441-8a7b-2cab2436f5d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:28:55 user nova-compute[74233]:   <uuid>68ef0023-a3cc-4441-8a7b-2cab2436f5d3</uuid>
Oct 20 18:28:55 user nova-compute[74233]:   <name>instance-00000027</name>
Oct 20 18:28:55 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:28:55 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:28:55 user nova-compute[74233]:   <metadata>
Oct 20 18:28:55 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:28:55 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:28:55 user nova-compute[74233]:       <nova:name>tempest-VolumesActionsTest-instance-1635686731</nova:name>
Oct 20 18:28:55 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:28:55</nova:creationTime>
Oct 20 18:28:55 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:28:55 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:28:55 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:28:55 user nova-compute[74233]:       <nova:owner>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:user uuid="435b9a61a87b4568907c0111eb303002">tempest-VolumesActionsTest-385103950-project-member</nova:user>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:project uuid="14cbc79b631448f39eb01b0034200e32">tempest-VolumesActionsTest-385103950</nova:project>
Oct 20 18:28:55 user nova-compute[74233]:       </nova:owner>
Oct 20 18:28:55 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:28:55 user nova-compute[74233]:       <nova:ports>
Oct 20 18:28:55 user nova-compute[74233]:         <nova:port uuid="c77dedf5-6cfe-419a-b050-3759e6bce832">
Oct 20 18:28:55 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:28:55 user nova-compute[74233]:         </nova:port>
Oct 20 18:28:55 user nova-compute[74233]:       </nova:ports>
Oct 20 18:28:55 user nova-compute[74233]:     </nova:instance>
Oct 20 18:28:55 user nova-compute[74233]:   </metadata>
Oct 20 18:28:55 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:28:55 user nova-compute[74233]:     <system>
Oct 20 18:28:55 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:28:55 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:28:55 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:28:55 user nova-compute[74233]:       <entry name="serial">68ef0023-a3cc-4441-8a7b-2cab2436f5d3</entry>
Oct 20 18:28:55 user nova-compute[74233]:       <entry name="uuid">68ef0023-a3cc-4441-8a7b-2cab2436f5d3</entry>
Oct 20 18:28:55 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:28:55 user nova-compute[74233]:     </system>
Oct 20 18:28:55 user nova-compute[74233]:   </sysinfo>
Oct 20 18:28:55 user nova-compute[74233]:   <os>
Oct 20 18:28:55 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:28:55 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:28:55 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:28:55 user nova-compute[74233]:   </os>
Oct 20 18:28:55 user nova-compute[74233]:   <features>
Oct 20 18:28:55 user nova-compute[74233]:     <acpi/>
Oct 20 18:28:55 user nova-compute[74233]:     <apic/>
Oct 20 18:28:55 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:28:55 user nova-compute[74233]:   </features>
Oct 20 18:28:55 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:28:55 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:28:55 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:28:55 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:28:55 user nova-compute[74233]:   </clock>
Oct 20 18:28:55 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:28:55 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:28:55 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:28:55 user nova-compute[74233]:   </cpu>
Oct 20 18:28:55 user nova-compute[74233]:   <devices>
Oct 20 18:28:55 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:28:55 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:28:55 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk"/>
Oct 20 18:28:55 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:28:55 user nova-compute[74233]:     </disk>
Oct 20 18:28:55 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:28:55 user nova-compute[74233]:       <mac address="fa:16:3e:5c:1d:d5"/>
Oct 20 18:28:55 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:28:55 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:28:55 user nova-compute[74233]:       <target dev="tapc77dedf5-6c"/>
Oct 20 18:28:55 user nova-compute[74233]:     </interface>
Oct 20 18:28:55 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:28:55 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/console.log" append="off"/>
Oct 20 18:28:55 user nova-compute[74233]:     </serial>
Oct 20 18:28:55 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:28:55 user nova-compute[74233]:     <video>
Oct 20 18:28:55 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:28:55 user nova-compute[74233]:     </video>
Oct 20 18:28:55 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:28:55 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:28:55 user nova-compute[74233]:     </rng>
Oct 20 18:28:55 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:28:55 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:28:55 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:28:55 user nova-compute[74233]:     </memballoon>
Oct 20 18:28:55 user nova-compute[74233]:   </devices>
Oct 20 18:28:55 user nova-compute[74233]: </domain>
Oct 20 18:28:55 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1635686731',display_name='tempest-VolumesActionsTest-instance-1635686731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1635686731',id=39,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14cbc79b631448f39eb01b0034200e32',ramdisk_id='',reservation_id='r-3i84bhpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-385103950',owner_user_name='tempest-VolumesActionsTest-385103950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:28:53Z,user_data=None,user_id='435b9a61a87b4568907c0111eb303002',uuid=68ef0023-a3cc-4441-8a7b-2cab2436f5d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Converting VIF {"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG os_vif [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a18b66ef-bc07-5dac-931c-64e1a0f9e038', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc77dedf5-6c, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc77dedf5-6c, col_values=(('qos', UUID('ec2746ba-24d4-483a-be0e-f1d1488347fa')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc77dedf5-6c, col_values=(('external_ids', {'iface-id': 'c77dedf5-6cfe-419a-b050-3759e6bce832', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:1d:d5', 'vm-uuid': '68ef0023-a3cc-4441-8a7b-2cab2436f5d3'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:55 user nova-compute[74233]: INFO os_vif [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c')
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] No VIF found with MAC fa:16:3e:5c:1d:d5, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.neutron [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Updated VIF entry in instance network info cache for port c77dedf5-6cfe-419a-b050-3759e6bce832. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG nova.network.neutron [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Updating instance_info_cache with network_info: [{"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a2aab827-1d8b-44b5-a373-421a86b67c8b req-ad114875-fbbe-4857-8631-de1eb3126032 service nova] Releasing lock "refresh_cache-68ef0023-a3cc-4441-8a7b-2cab2436f5d3" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:28:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-7bf2d658-817e-4f8f-8522-286de263cfef req-288d23fa-489a-4abf-8b5e-e8a686e4c31f service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7bf2d658-817e-4f8f-8522-286de263cfef req-288d23fa-489a-4abf-8b5e-e8a686e4c31f service nova] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7bf2d658-817e-4f8f-8522-286de263cfef req-288d23fa-489a-4abf-8b5e-e8a686e4c31f service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7bf2d658-817e-4f8f-8522-286de263cfef req-288d23fa-489a-4abf-8b5e-e8a686e4c31f service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-7bf2d658-817e-4f8f-8522-286de263cfef req-288d23fa-489a-4abf-8b5e-e8a686e4c31f service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] No waiting events found dispatching network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:28:56 user nova-compute[74233]: WARNING nova.compute.manager [req-7bf2d658-817e-4f8f-8522-286de263cfef req-288d23fa-489a-4abf-8b5e-e8a686e4c31f service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received unexpected event network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 for instance with vm_state building and task_state spawning.
Oct 20 18:28:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:28:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-18a5508b-07df-453b-889f-7f4ded6f1aed req-f9a6fb00-e741-45c0-80fa-82063dfc21c2 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:28:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-18a5508b-07df-453b-889f-7f4ded6f1aed req-f9a6fb00-e741-45c0-80fa-82063dfc21c2 service nova] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:28:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-18a5508b-07df-453b-889f-7f4ded6f1aed req-f9a6fb00-e741-45c0-80fa-82063dfc21c2 service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:28:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-18a5508b-07df-453b-889f-7f4ded6f1aed req-f9a6fb00-e741-45c0-80fa-82063dfc21c2 service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:28:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-18a5508b-07df-453b-889f-7f4ded6f1aed req-f9a6fb00-e741-45c0-80fa-82063dfc21c2 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] No waiting events found dispatching network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:28:58 user nova-compute[74233]: WARNING nova.compute.manager [req-18a5508b-07df-453b-889f-7f4ded6f1aed req-f9a6fb00-e741-45c0-80fa-82063dfc21c2 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received unexpected event network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 for instance with vm_state building and task_state spawning.
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:28:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Instance spawned successfully.
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:28:59 user nova-compute[74233]: INFO nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 20 18:28:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:28:59 user nova-compute[74233]: INFO nova.compute.manager [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Took 6.51 seconds to build instance.
Oct 20 18:28:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f3a58a4c-7ec4-448a-893a-1b13ac15992e tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.610s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:00 user nova-compute[74233]: INFO nova.compute.manager [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Terminating instance
Oct 20 18:29:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-82349914-ec7f-4114-8664-cf88cb3b5acf req-b24eb94c-ab53-4141-885a-a41ef9c1b3cf service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-82349914-ec7f-4114-8664-cf88cb3b5acf req-b24eb94c-ab53-4141-885a-a41ef9c1b3cf service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-82349914-ec7f-4114-8664-cf88cb3b5acf req-b24eb94c-ab53-4141-885a-a41ef9c1b3cf service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-82349914-ec7f-4114-8664-cf88cb3b5acf req-b24eb94c-ab53-4141-885a-a41ef9c1b3cf service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-82349914-ec7f-4114-8664-cf88cb3b5acf req-b24eb94c-ab53-4141-885a-a41ef9c1b3cf service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-82349914-ec7f-4114-8664-cf88cb3b5acf req-b24eb94c-ab53-4141-885a-a41ef9c1b3cf service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Instance destroyed successfully.
Oct 20 18:29:01 user nova-compute[74233]: DEBUG nova.objects.instance [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'resources' on Instance uuid aeb06e35-8797-4a76-a54b-f4d2dbb329d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-13211816',display_name='tempest-ServerActionsTestOtherA-server-1359886685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-13211816',id=32,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDkG3eixSC9gYo6kNgsId3y7xJBVqfNTJcfeDkXB4fKSG6GYa7Hxh97vm3lDnEBW3Dhhhctco6EJLFmoisxDflzxlnK3Z6N6U7kZND6xrKsWC9Kbr/+pjFjQ0QfP6rlvw==',key_name='tempest-keypair-142935039',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:25:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-mhezx8yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:25:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=aeb06e35-8797-4a76-a54b-f4d2dbb329d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "10c936e6-7609-4bd3-9374-e18e5503c689", "address": "fa:16:3e:1d:b1:ef", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c936e6-76", "ovs_interfaceid": "10c936e6-7609-4bd3-9374-e18e5503c689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG os_vif [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10c936e6-76, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84825548-61b6-45fa-8bbd-f857e21fb0ab) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:29:01 user nova-compute[74233]: INFO os_vif [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b1:ef,bridge_name='br-int',has_traffic_filtering=True,id=10c936e6-7609-4bd3-9374-e18e5503c689,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c936e6-76')
Oct 20 18:29:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Deleting instance files /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3_del
Oct 20 18:29:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Deletion of /opt/stack/data/nova/instances/aeb06e35-8797-4a76-a54b-f4d2dbb329d3_del complete
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: INFO nova.compute.manager [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 18:29:01 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:02 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Took 0.80 seconds to deallocate network for instance.
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-75a81b19-af65-4ee7-b940-b591fc625033 req-1c44c42c-dab2-421b-ab58-287e0d9b1f39 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-deleted-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: INFO nova.compute.manager [req-75a81b19-af65-4ee7-b940-b591fc625033 req-1c44c42c-dab2-421b-ab58-287e0d9b1f39 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Neutron deleted interface 10c936e6-7609-4bd3-9374-e18e5503c689; detaching it from the instance and deleting it from the info cache
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-75a81b19-af65-4ee7-b940-b591fc625033 req-1c44c42c-dab2-421b-ab58-287e0d9b1f39 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-75a81b19-af65-4ee7-b940-b591fc625033 req-1c44c42c-dab2-421b-ab58-287e0d9b1f39 service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Detach interface failed, port_id=10c936e6-7609-4bd3-9374-e18e5503c689, reason: Instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Deleted allocations for instance aeb06e35-8797-4a76-a54b-f4d2dbb329d3
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-15d7fa66-cba8-457b-ae59-cc34b3b25f9d tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:02 user nova-compute[74233]: WARNING nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state deleted and task_state None.
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:02 user nova-compute[74233]: WARNING nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state deleted and task_state None.
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:02 user nova-compute[74233]: WARNING nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state deleted and task_state None.
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:02 user nova-compute[74233]: WARNING nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-unplugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state deleted and task_state None.
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Acquiring lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] Lock "aeb06e35-8797-4a76-a54b-f4d2dbb329d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] No waiting events found dispatching network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:02 user nova-compute[74233]: WARNING nova.compute.manager [req-31c8ef8b-e318-49c0-89a2-b23cd724b56a req-85c2209d-acb4-465b-a6a0-2117bc9a5b9c service nova] [instance: aeb06e35-8797-4a76-a54b-f4d2dbb329d3] Received unexpected event network-vif-plugged-10c936e6-7609-4bd3-9374-e18e5503c689 for instance with vm_state deleted and task_state None.
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-changed-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Refreshing instance network info cache due to event network-changed-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] Acquiring lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] Acquired lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:29:02 user nova-compute[74233]: DEBUG nova.network.neutron [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Refreshing network info cache for port b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'flavor' on Instance uuid b846b73b-60c6-494f-b016-fccc18b6c15f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:03 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Ignoring supplied device name: /dev/vdb
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ff7154f5-24d7-4a94-87a6-ceb6cb556772 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.155s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updated VIF entry in instance network info cache for port b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updating instance_info_cache with network_info: [{"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bc280825-0e5d-43e4-a351-0d24fa8a4509 req-36c3e1e1-a8af-4035-b840-a918fb95dee4 service nova] Releasing lock "refresh_cache-b846b73b-60c6-494f-b016-fccc18b6c15f" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:03 user nova-compute[74233]: INFO nova.compute.manager [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Attaching volume 88424e8a-d3f9-49c0-84ec-a46efd95b552 to /dev/vdb
Oct 20 18:29:03 user nova-compute[74233]: DEBUG os_brick.utils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba3212f-ac62-49b1-a1ef-83b684b02448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07668fd5-bc86-4064-9611-1a40a37a123d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155630c-6d95-4e74-91fe-aee9c7d11b7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d3f5a9-04e2-42ac-a3a0-9aa1e287ca04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:29:03 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd9db9f-0c11-485c-b148-379353058722]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG os_brick.utils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updating existing volume attachment record: f73c0279-dcdf-4cb0-98b9-411198ffd000 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:29:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:04 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:05 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:29:08 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=7870MB free_disk=25.093456268310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance b846b73b-60c6-494f-b016-fccc18b6c15f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 42907c0b-8e5a-43d8-9898-a78f47f4bfed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 68ef0023-a3cc-4441-8a7b-2cab2436f5d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:29:08 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:29:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:29:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:29:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:29:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:29:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:29:11 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:29:12 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating instance_info_cache with network_info: [{"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-362fb740-c18c-44f7-a034-ff26f2d1d588" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:29:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:29:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing instance network info cache due to event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updated VIF entry in instance network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:29:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-175daec7-5ec8-43d2-adde-ee04630de951 req-537ca4fd-77a4-4fef-b255-4a2b8866dbff service nova] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:29:20 user nova-compute[74233]: INFO nova.compute.manager [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Detaching volume 4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:29:20 user nova-compute[74233]: INFO nova.virt.block_device [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Attempting to driver detach volume 4ef4a842-4d4f-4db3-bb79-0ac8390d25aa from mountpoint /dev/vdb
Oct 20 18:29:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Attempting to detach device vdb from instance 2753b305-f0cb-409c-b66a-e06a99378c08 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:29:20 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:29:20 user nova-compute[74233]:   <source dev="/dev/sde"/>
Oct 20 18:29:20 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:29:20 user nova-compute[74233]:   <serial>4ef4a842-4d4f-4db3-bb79-0ac8390d25aa</serial>
Oct 20 18:29:20 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:29:20 user nova-compute[74233]: </disk>
Oct 20 18:29:20 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:29:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully detached device vdb from instance 2753b305-f0cb-409c-b66a-e06a99378c08 from the persistent domain config.
Oct 20 18:29:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2753b305-f0cb-409c-b66a-e06a99378c08 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:29:20 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:29:20 user nova-compute[74233]:   <source dev="/dev/sde"/>
Oct 20 18:29:20 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:29:20 user nova-compute[74233]:   <serial>4ef4a842-4d4f-4db3-bb79-0ac8390d25aa</serial>
Oct 20 18:29:20 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:29:20 user nova-compute[74233]: </disk>
Oct 20 18:29:20 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:29:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing instance network info cache due to event network-changed-157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] Acquiring lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] Acquired lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG nova.network.neutron [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Refreshing network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG nova.network.neutron [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updated VIF entry in instance network info cache for port 157e864c-8ac5-422d-a7a1-7252ef76cee1. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG nova.network.neutron [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [{"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4e950f87-899a-4221-a82f-aec8b078bbe0 req-824ae7d1-7115-442a-ba06-e5209f70a949 service nova] Releasing lock "refresh_cache-2753b305-f0cb-409c-b66a-e06a99378c08" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:29:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG nova.objects.instance [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:29 user nova-compute[74233]: INFO nova.compute.manager [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attaching volume 324e1376-d002-4b7e-aea7-e60244f3fd4e to /dev/vdb
Oct 20 18:29:29 user nova-compute[74233]: DEBUG os_brick.utils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e983e9-1a4e-4e26-bb26-fd55d7acc40a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c549b125-ac42-47f8-9cea-d7871ddeb5c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9c137c-b72d-4708-86e4-e8a7b2e5bd23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb765480-fe8c-4722-bdf3-402b106f2fad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:29:29 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:29:29 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b60ba4-7240-4cf2-9a72-7a2324a8edf0]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG os_brick.utils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:29:29 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating existing volume attachment record: 6258cfb4-ae2f-4d6e-a9c4-7b66dcfcf69a {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:29:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSOEiDUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:29:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:29:32 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:29:32 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608b98f-bd09-4a1b-9e42-5c679a02c392]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:29:32 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf84be5-d46f-4090-b8ae-fc3bb8b7e1e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552] added
Oct 20 18:29:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a225b-8f9c-47f4-ae3a-77e8a76cb343]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[633b197a-de64-42d7-98cb-31a86f852939]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSOEiDUs {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSOEiDUs" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492c387-6c0d-46fe-b39a-4ee911a13990]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NSOEiDUs'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d14b682-62ea-4bea-a408-7ed349d4876b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e87a6-f00c-40f3-8a95-a5a975c020be]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:29:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:29:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba68de-a259-4097-8048-6dd3c90aca35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260]
Oct 20 18:29:32 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260] successful.
Oct 20 18:29:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba7a880-9252-47ad-bf5e-cdd4f579b851]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b28bdf-0e15-42a2-8094-044ee392f0d6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:29:32 user nova-compute[74233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:29:32 user nova-compute[74233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:32 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e1e8c-97fc-4e3c-a12a-ffbede1ed0f4]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:29:32 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSOEiDUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:29:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:29:33 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26633323762313263', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:29:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633323762313263', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:29:33 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'flavor' on Instance uuid b846b73b-60c6-494f-b016-fccc18b6c15f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:33 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:29:33 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:29:33 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:29:33 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:29:33 user nova-compute[74233]:   <serial>88424e8a-d3f9-49c0-84ec-a46efd95b552</serial>
Oct 20 18:29:33 user nova-compute[74233]: </disk>
Oct 20 18:29:33 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:34 user nova-compute[74233]: INFO nova.compute.manager [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Terminating instance
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] No VIF found with MAC fa:16:3e:2c:eb:73, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8925d92e-e5af-4fce-a39d-bf198fd8a74d tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.062s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-862c9828-54af-45f5-b473-d329762cd9ef req-59c153f4-bd0d-49b6-aeb4-13b81c8add45 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-vif-unplugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-862c9828-54af-45f5-b473-d329762cd9ef req-59c153f4-bd0d-49b6-aeb4-13b81c8add45 service nova] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-862c9828-54af-45f5-b473-d329762cd9ef req-59c153f4-bd0d-49b6-aeb4-13b81c8add45 service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-862c9828-54af-45f5-b473-d329762cd9ef req-59c153f4-bd0d-49b6-aeb4-13b81c8add45 service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-862c9828-54af-45f5-b473-d329762cd9ef req-59c153f4-bd0d-49b6-aeb4-13b81c8add45 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] No waiting events found dispatching network-vif-unplugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.compute.manager [req-862c9828-54af-45f5-b473-d329762cd9ef req-59c153f4-bd0d-49b6-aeb4-13b81c8add45 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-vif-unplugged-fc78207e-f23d-4e43-86c4-d509514eae63 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:29:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Instance destroyed successfully.
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.objects.instance [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lazy-loading 'resources' on Instance uuid 42907c0b-8e5a-43d8-9898-a78f47f4bfed {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1277829570',display_name='tempest-VolumesNegativeTest-instance-1277829570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1277829570',id=38,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:27:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='448d5ec959db41acaaae6316c072a7be',ramdisk_id='',reservation_id='r-cm2tjivw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-968772716',owner_user_name='tempest-VolumesNegativeTest-968772716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:27:52Z,user_data=None,user_id='f118f66b77324814b79c81c27b06a044',uuid=42907c0b-8e5a-43d8-9898-a78f47f4bfed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Converting VIF {"id": "fc78207e-f23d-4e43-86c4-d509514eae63", "address": "fa:16:3e:0f:44:0d", "network": {"id": "ecfa8da1-1330-4fab-ba6a-16e128b25519", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "770c5ca287434bdd8872b323dc3c6507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78207e-f2", "ovs_interfaceid": "fc78207e-f23d-4e43-86c4-d509514eae63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG os_vif [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc78207e-f2, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=389bf9b1-0040-4296-82a8-745f0d966fe1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:29:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:29:34 user nova-compute[74233]: INFO os_vif [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:44:0d,bridge_name='br-int',has_traffic_filtering=True,id=fc78207e-f23d-4e43-86c4-d509514eae63,network=Network(ecfa8da1-1330-4fab-ba6a-16e128b25519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78207e-f2')
Oct 20 18:29:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Deleting instance files /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed_del
Oct 20 18:29:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Deletion of /opt/stack/data/nova/instances/42907c0b-8e5a-43d8-9898-a78f47f4bfed_del complete
Oct 20 18:29:34 user nova-compute[74233]: INFO nova.compute.manager [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 20 18:29:35 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:35 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Took 0.45 seconds to deallocate network for instance.
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-f17f813d-6977-4ad6-ae80-1b9f73c8eecb req-42121888-f38e-471d-a780-e0d45f2185a3 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-vif-deleted-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:35 user nova-compute[74233]: INFO nova.compute.manager [req-f17f813d-6977-4ad6-ae80-1b9f73c8eecb req-42121888-f38e-471d-a780-e0d45f2185a3 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Neutron deleted interface fc78207e-f23d-4e43-86c4-d509514eae63; detaching it from the instance and deleting it from the info cache
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.network.neutron [req-f17f813d-6977-4ad6-ae80-1b9f73c8eecb req-42121888-f38e-471d-a780-e0d45f2185a3 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.compute.manager [req-f17f813d-6977-4ad6-ae80-1b9f73c8eecb req-42121888-f38e-471d-a780-e0d45f2185a3 service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Detach interface failed, port_id=fc78207e-f23d-4e43-86c4-d509514eae63, reason: Instance 42907c0b-8e5a-43d8-9898-a78f47f4bfed could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:35 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Deleted allocations for instance 42907c0b-8e5a-43d8-9898-a78f47f4bfed
Oct 20 18:29:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-05976ad1-ff90-479c-85cf-ead2dbb770f8 tempest-VolumesNegativeTest-968772716 tempest-VolumesNegativeTest-968772716-project-member] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.690s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-df3214e2-38fa-4ba9-b12c-4da61b90b1f5 req-cc50ffa1-488b-4ea0-85a9-0789ad48de6b service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received event network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:29:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-df3214e2-38fa-4ba9-b12c-4da61b90b1f5 req-cc50ffa1-488b-4ea0-85a9-0789ad48de6b service nova] Acquiring lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-df3214e2-38fa-4ba9-b12c-4da61b90b1f5 req-cc50ffa1-488b-4ea0-85a9-0789ad48de6b service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-df3214e2-38fa-4ba9-b12c-4da61b90b1f5 req-cc50ffa1-488b-4ea0-85a9-0789ad48de6b service nova] Lock "42907c0b-8e5a-43d8-9898-a78f47f4bfed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-df3214e2-38fa-4ba9-b12c-4da61b90b1f5 req-cc50ffa1-488b-4ea0-85a9-0789ad48de6b service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] No waiting events found dispatching network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:29:36 user nova-compute[74233]: WARNING nova.compute.manager [req-df3214e2-38fa-4ba9-b12c-4da61b90b1f5 req-cc50ffa1-488b-4ea0-85a9-0789ad48de6b service nova] [instance: 42907c0b-8e5a-43d8-9898-a78f47f4bfed] Received unexpected event network-vif-plugged-fc78207e-f23d-4e43-86c4-d509514eae63 for instance with vm_state deleted and task_state None.
Oct 20 18:29:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2753b305-f0cb-409c-b66a-e06a99378c08 is timed out.
Oct 20 18:29:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully detached device vdb from instance 2753b305-f0cb-409c-b66a-e06a99378c08 from the live domain config.
Oct 20 18:29:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuCrLqQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:29:40 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7150586-73b4-4676-9133-e98936c9fcbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:29:40 user nova-compute[74233]: No targets found.
Oct 20 18:29:40 user nova-compute[74233]: iSNS:
Oct 20 18:29:40 user nova-compute[74233]: No targets found.
Oct 20 18:29:40 user nova-compute[74233]: STATIC:
Oct 20 18:29:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa
Oct 20 18:29:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:29:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:29:40 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552
Oct 20 18:29:40 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:29:40 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:29:40 user nova-compute[74233]: FIRMWARE:
Oct 20 18:29:40 user nova-compute[74233]: No targets found.
Oct 20 18:29:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:29:40 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:29:40 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f54cb-ac9f-4aa8-a7ef-f7ef8883c7e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5814dbb-395a-4376-850e-3bbf8eb8dfd3]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:29:40 user nova-compute[74233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa (non-flash)
Oct 20 18:29:40 user nova-compute[74233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9506c89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa'): ({'sde'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Removing single pathed devices sde {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d96324-488a-4925-afbc-d4d69b5672d9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20961be0-aa6d-4b51-9a2a-f29a41851526]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Flushing IO for device /dev/sde {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9705872b-f59c-459d-a59b-57c63d30fd0a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee84c827-f74c-4357-8482-d960fe331ae9]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] SCSI volumes sde have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b4850-3a5f-4ef6-9629-b90156707ad9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[400dfe8c-d68e-4e6d-8af8-282624c6e941]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260]
Oct 20 18:29:40 user nova-compute[74233]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa, portal: 172.16.0.220,3260] successful.
Oct 20 18:29:40 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef4a842-4d4f-4db3-bb79-0ac8390d25aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da8624-9104-48e8-a282-c7afc48b7a93]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] <== disconnect_volume: return (330ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:29:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:29:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG nova.objects.instance [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'flavor' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-0ff71477-c4ca-42f0-b320-1f76015e13d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.524s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PghJMlAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:29:47 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:29:47 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:29:47 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[11259852-25d9-4882-a779-e6b748247808]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:29:47 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252bde8-f55d-40f8-84da-704b3d176563]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e] added
Oct 20 18:29:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5276f9d5-1ca0-4e5a-a9a2-6308e25664b7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f29873a-5045-423c-a5a6-755219b1ccb5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PghJMlAY {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PghJMlAY" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ba7b3-5840-4901-babc-303b28de9e92]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PghJMlAY'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae3fc9-eb78-4dfa-9336-2bd392773821]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4e7c8a-8622-4c4b-aa30-1faf4a8edb63]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:29:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2f6a11-96d3-4425-ac95-7f65674ea849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260]
Oct 20 18:29:48 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260] successful.
Oct 20 18:29:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d464ee4-4132-4905-8678-a2e117cb3c89]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d2eaa6-0097-4120-a352-61eebed4c38e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:48 user nova-compute[74233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e (non-flash)
Oct 20 18:29:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:29:48 user nova-compute[74233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e (non-flash)
Oct 20 18:29:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535f7f2-022f-4a2f-9a22-c662f60fddcf]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:29:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PghJMlAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26138356439376664', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138356439376664', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:29:49 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:29:49 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:29:49 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:29:49 user nova-compute[74233]:   <serial>324e1376-d002-4b7e-aea7-e60244f3fd4e</serial>
Oct 20 18:29:49 user nova-compute[74233]: </disk>
Oct 20 18:29:49 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] No VIF found with MAC fa:16:3e:74:9a:63, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-546ee7b4-17c5-49be-9065-14e450e21709 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.966s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:29:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:29:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:29:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:29:51 user nova-compute[74233]: INFO nova.compute.manager [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Detaching volume 324e1376-d002-4b7e-aea7-e60244f3fd4e
Oct 20 18:29:51 user nova-compute[74233]: INFO nova.virt.block_device [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Attempting to driver detach volume 324e1376-d002-4b7e-aea7-e60244f3fd4e from mountpoint /dev/vdb
Oct 20 18:29:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Attempting to detach device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:29:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:29:51 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:29:51 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:29:51 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:29:51 user nova-compute[74233]:   <serial>324e1376-d002-4b7e-aea7-e60244f3fd4e</serial>
Oct 20 18:29:51 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:29:51 user nova-compute[74233]: </disk>
Oct 20 18:29:51 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:29:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the persistent domain config.
Oct 20 18:29:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:29:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:29:51 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:29:51 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:29:51 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:29:51 user nova-compute[74233]:   <serial>324e1376-d002-4b7e-aea7-e60244f3fd4e</serial>
Oct 20 18:29:51 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:29:51 user nova-compute[74233]: </disk>
Oct 20 18:29:51 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:29:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:29:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:29:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:03 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:05 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:05 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:05 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:30:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8075MB free_disk=25.090473175048828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 2753b305-f0cb-409c-b66a-e06a99378c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance b846b73b-60c6-494f-b016-fccc18b6c15f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 68ef0023-a3cc-4441-8a7b-2cab2436f5d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:10 user nova-compute[74233]: INFO nova.compute.manager [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Terminating instance
Oct 20 18:30:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ca89d1c-440a-43ed-922e-bf9ee782c20e req-9007b885-2781-4424-bb44-08736f36c2f7 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ca89d1c-440a-43ed-922e-bf9ee782c20e req-9007b885-2781-4424-bb44-08736f36c2f7 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ca89d1c-440a-43ed-922e-bf9ee782c20e req-9007b885-2781-4424-bb44-08736f36c2f7 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ca89d1c-440a-43ed-922e-bf9ee782c20e req-9007b885-2781-4424-bb44-08736f36c2f7 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ca89d1c-440a-43ed-922e-bf9ee782c20e req-9007b885-2781-4424-bb44-08736f36c2f7 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ca89d1c-440a-43ed-922e-bf9ee782c20e req-9007b885-2781-4424-bb44-08736f36c2f7 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-unplugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Instance destroyed successfully.
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'resources' on Instance uuid 2753b305-f0cb-409c-b66a-e06a99378c08 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266827241',display_name='tempest-ServerRescueNegativeTestJSON-server-1266827241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266827241',id=35,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAnd2569lRXlRuOBKhGNt53usojGkjn2y9Rrev1olWo2VXMzLNTKwAbsZhdkHOGj+k8dBqGvILvC2hTQNn+lB3TXMN83LM2EfXEc/y6YHPaJDstVx51RQ6RNE78Ol0bmg==',key_name='tempest-keypair-1823172263',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-kullwdf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=2753b305-f0cb-409c-b66a-e06a99378c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "address": "fa:16:3e:cb:cf:83", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157e864c-8a", "ovs_interfaceid": "157e864c-8ac5-422d-a7a1-7252ef76cee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG os_vif [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap157e864c-8a, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58382a66-e781-42a4-ab71-dae5094336d1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:11 user nova-compute[74233]: INFO os_vif [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:cf:83,bridge_name='br-int',has_traffic_filtering=True,id=157e864c-8ac5-422d-a7a1-7252ef76cee1,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157e864c-8a')
Oct 20 18:30:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Deleting instance files /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08_del
Oct 20 18:30:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Deletion of /opt/stack/data/nova/instances/2753b305-f0cb-409c-b66a-e06a99378c08_del complete
Oct 20 18:30:11 user nova-compute[74233]: INFO nova.compute.manager [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 18:30:11 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:30:11 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Took 0.59 seconds to deallocate network for instance.
Oct 20 18:30:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-75554bcf-c78f-4b26-a13b-0e8254241d2b req-fbcbb77e-9d82-4b14-a90b-130adb65f1fc service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-deleted-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:12 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Deleted allocations for instance 2753b305-f0cb-409c-b66a-e06a99378c08
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ee40f305-36ff-497c-9d50-913ed5a25fe0 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "2753b305-f0cb-409c-b66a-e06a99378c08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 is timed out.
Oct 20 18:30:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully detached device vdb from instance 362fb740-c18c-44f7-a034-ff26f2d1d588 from the live domain config.
Oct 20 18:30:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PghJMlAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:30:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86261775-3f2d-4b4a-ae38-b04a3a1477ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:30:12 user nova-compute[74233]: No targets found.
Oct 20 18:30:12 user nova-compute[74233]: iSNS:
Oct 20 18:30:12 user nova-compute[74233]: No targets found.
Oct 20 18:30:12 user nova-compute[74233]: STATIC:
Oct 20 18:30:12 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552
Oct 20 18:30:12 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:30:12 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:30:12 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e
Oct 20 18:30:12 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:30:12 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:30:12 user nova-compute[74233]: FIRMWARE:
Oct 20 18:30:12 user nova-compute[74233]: No targets found.
Oct 20 18:30:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:30:12 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:30:12 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf3410-e926-4baf-872e-9c87b596af1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da0192d-c47b-47ec-8932-2167d9333bb9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:30:12 user nova-compute[74233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e (non-flash)
Oct 20 18:30:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:30:12 user nova-compute[74233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e (non-flash)
Oct 20 18:30:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9801e8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020f64e-0e3f-4c3d-8736-b01679d614a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[605bf675-3194-4a64-9309-fcb5fb8f4202]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1a72ca-119f-4963-ac73-5da9a625cc34]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb1a8b-1b58-4efd-9513-841ba6af8cd0]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89afa0f-2744-4e1a-bd83-16690c99db43]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e354b3a-202f-4e0f-a840-466fc9ac9226]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260]
Oct 20 18:30:12 user nova-compute[74233]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e, portal: 172.16.0.220,3260] successful.
Oct 20 18:30:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e1376-d002-4b7e-aea7-e60244f3fd4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb2d7cc-e9b5-4f62-8b29-aa114989204a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] <== disconnect_volume: return (286ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d75ee2f-718c-49ce-9004-06cc4df6fac4 req-782bd6d2-c6ab-46cc-934f-b1e9c31dcf13 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d75ee2f-718c-49ce-9004-06cc4df6fac4 req-782bd6d2-c6ab-46cc-934f-b1e9c31dcf13 service nova] Acquiring lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d75ee2f-718c-49ce-9004-06cc4df6fac4 req-782bd6d2-c6ab-46cc-934f-b1e9c31dcf13 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1d75ee2f-718c-49ce-9004-06cc4df6fac4 req-782bd6d2-c6ab-46cc-934f-b1e9c31dcf13 service nova] Lock "2753b305-f0cb-409c-b66a-e06a99378c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:12 user nova-compute[74233]: DEBUG nova.compute.manager [req-1d75ee2f-718c-49ce-9004-06cc4df6fac4 req-782bd6d2-c6ab-46cc-934f-b1e9c31dcf13 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] No waiting events found dispatching network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:30:12 user nova-compute[74233]: WARNING nova.compute.manager [req-1d75ee2f-718c-49ce-9004-06cc4df6fac4 req-782bd6d2-c6ab-46cc-934f-b1e9c31dcf13 service nova] [instance: 2753b305-f0cb-409c-b66a-e06a99378c08] Received unexpected event network-vif-plugged-157e864c-8ac5-422d-a7a1-7252ef76cee1 for instance with vm_state deleted and task_state None.
Oct 20 18:30:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:30:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:30:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:30:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:22 user nova-compute[74233]: DEBUG nova.objects.instance [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'flavor' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:30:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87f6c567-e1ee-4706-96aa-2edd012246c8 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.290s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:40 user nova-compute[74233]: INFO nova.compute.manager [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Detaching volume 88424e8a-d3f9-49c0-84ec-a46efd95b552
Oct 20 18:30:40 user nova-compute[74233]: INFO nova.virt.block_device [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Attempting to driver detach volume 88424e8a-d3f9-49c0-84ec-a46efd95b552 from mountpoint /dev/vdb
Oct 20 18:30:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Attempting to detach device vdb from instance b846b73b-60c6-494f-b016-fccc18b6c15f from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:30:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:30:40 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:30:40 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:30:40 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:30:40 user nova-compute[74233]:   <serial>88424e8a-d3f9-49c0-84ec-a46efd95b552</serial>
Oct 20 18:30:40 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:30:40 user nova-compute[74233]: </disk>
Oct 20 18:30:40 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:30:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully detached device vdb from instance b846b73b-60c6-494f-b016-fccc18b6c15f from the persistent domain config.
Oct 20 18:30:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b846b73b-60c6-494f-b016-fccc18b6c15f from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:30:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:30:40 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:30:40 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:30:40 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:30:40 user nova-compute[74233]:   <serial>88424e8a-d3f9-49c0-84ec-a46efd95b552</serial>
Oct 20 18:30:40 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:30:40 user nova-compute[74233]: </disk>
Oct 20 18:30:40 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:30:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:41 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b846b73b-60c6-494f-b016-fccc18b6c15f {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:30:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:30:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:30:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:30:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:30:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:30:59 user nova-compute[74233]: INFO nova.compute.manager [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Terminating instance
Oct 20 18:30:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-73e9d15e-f968-459f-a5a4-3515cd868876 req-3d7ed335-49f1-43b2-98f1-5bdad99a72b7 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-vif-unplugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73e9d15e-f968-459f-a5a4-3515cd868876 req-3d7ed335-49f1-43b2-98f1-5bdad99a72b7 service nova] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73e9d15e-f968-459f-a5a4-3515cd868876 req-3d7ed335-49f1-43b2-98f1-5bdad99a72b7 service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-73e9d15e-f968-459f-a5a4-3515cd868876 req-3d7ed335-49f1-43b2-98f1-5bdad99a72b7 service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-73e9d15e-f968-459f-a5a4-3515cd868876 req-3d7ed335-49f1-43b2-98f1-5bdad99a72b7 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] No waiting events found dispatching network-vif-unplugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-73e9d15e-f968-459f-a5a4-3515cd868876 req-3d7ed335-49f1-43b2-98f1-5bdad99a72b7 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-vif-unplugged-c77dedf5-6cfe-419a-b050-3759e6bce832 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:31:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Instance destroyed successfully.
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lazy-loading 'resources' on Instance uuid 68ef0023-a3cc-4441-8a7b-2cab2436f5d3 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1635686731',display_name='tempest-VolumesActionsTest-instance-1635686731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1635686731',id=39,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14cbc79b631448f39eb01b0034200e32',ramdisk_id='',reservation_id='r-3i84bhpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-385103950',owner_user_name='tempest-VolumesActionsTest-385103950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:28:59Z,user_data=None,user_id='435b9a61a87b4568907c0111eb303002',uuid=68ef0023-a3cc-4441-8a7b-2cab2436f5d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Converting VIF {"id": "c77dedf5-6cfe-419a-b050-3759e6bce832", "address": "fa:16:3e:5c:1d:d5", "network": {"id": "5baa14ee-bbc1-4955-8cdf-cf4bea1b13be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1559951959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14cbc79b631448f39eb01b0034200e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77dedf5-6c", "ovs_interfaceid": "c77dedf5-6cfe-419a-b050-3759e6bce832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG os_vif [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc77dedf5-6c, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec2746ba-24d4-483a-be0e-f1d1488347fa) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:00 user nova-compute[74233]: INFO os_vif [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1d:d5,bridge_name='br-int',has_traffic_filtering=True,id=c77dedf5-6cfe-419a-b050-3759e6bce832,network=Network(5baa14ee-bbc1-4955-8cdf-cf4bea1b13be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77dedf5-6c')
Oct 20 18:31:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Deleting instance files /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3_del
Oct 20 18:31:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Deletion of /opt/stack/data/nova/instances/68ef0023-a3cc-4441-8a7b-2cab2436f5d3_del complete
Oct 20 18:31:00 user nova-compute[74233]: INFO nova.compute.manager [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Took 0.77 seconds to destroy the instance on the hypervisor.
Oct 20 18:31:00 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:31:00 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:01 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Took 0.52 seconds to deallocate network for instance.
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-5af14d74-0fa6-4987-be6d-5a3880df459d req-00dd474c-8fab-4388-9d2f-c699e7b171c3 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-vif-deleted-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:01 user nova-compute[74233]: INFO nova.compute.manager [req-5af14d74-0fa6-4987-be6d-5a3880df459d req-00dd474c-8fab-4388-9d2f-c699e7b171c3 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Neutron deleted interface c77dedf5-6cfe-419a-b050-3759e6bce832; detaching it from the instance and deleting it from the info cache
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-5af14d74-0fa6-4987-be6d-5a3880df459d req-00dd474c-8fab-4388-9d2f-c699e7b171c3 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b846b73b-60c6-494f-b016-fccc18b6c15f is timed out.
Oct 20 18:31:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully detached device vdb from instance b846b73b-60c6-494f-b016-fccc18b6c15f from the live domain config.
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSOEiDUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:31:01 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.compute.manager [req-5af14d74-0fa6-4987-be6d-5a3880df459d req-00dd474c-8fab-4388-9d2f-c699e7b171c3 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Detach interface failed, port_id=c77dedf5-6cfe-419a-b050-3759e6bce832, reason: Instance 68ef0023-a3cc-4441-8a7b-2cab2436f5d3 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2290fd22-037b-4312-9a0e-eeecdaac9e06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:31:01 user nova-compute[74233]: No targets found.
Oct 20 18:31:01 user nova-compute[74233]: iSNS:
Oct 20 18:31:01 user nova-compute[74233]: No targets found.
Oct 20 18:31:01 user nova-compute[74233]: STATIC:
Oct 20 18:31:01 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552
Oct 20 18:31:01 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:31:01 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:31:01 user nova-compute[74233]: FIRMWARE:
Oct 20 18:31:01 user nova-compute[74233]: No targets found.
Oct 20 18:31:01 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:31:01 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:31:01 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d21e468-38bd-4a76-8d78-24b9734d6aa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c344ec5f-fba2-4126-9ffd-5a110bed414c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:31:01 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 (non-flash)
Oct 20 18:31:01 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9506ca5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037faea-f55e-4b56-a014-ccd8a3ae51df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5b61e-0fc1-4858-b9cb-3a3f65bac8bf]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91b918-8f02-41cc-a895-9ab0d2f672f6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb55e1-55ec-42f1-8e6d-8b9df8bdd332]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4acf7-dfae-4edf-adee-66884c5ca1e9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d354d5-a6ae-4cfb-9a1a-3dfad197dc8c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260]
Oct 20 18:31:01 user nova-compute[74233]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552, portal: 172.16.0.220,3260] successful.
Oct 20 18:31:01 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee3f48-4673-4afb-8886-c3d09f882827]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== disconnect_volume: return (338ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:31:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:31:01 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Deleted allocations for instance 68ef0023-a3cc-4441-8a7b-2cab2436f5d3
Oct 20 18:31:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b8970e50-3ad0-47f9-ba8a-a2790dafa6bc tempest-VolumesActionsTest-385103950 tempest-VolumesActionsTest-385103950-project-member] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.807s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-23b26d99-5b01-4d02-818b-676d58e638ba req-f66a570b-a356-4f2e-9c78-d01500138179 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received event network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b26d99-5b01-4d02-818b-676d58e638ba req-f66a570b-a356-4f2e-9c78-d01500138179 service nova] Acquiring lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b26d99-5b01-4d02-818b-676d58e638ba req-f66a570b-a356-4f2e-9c78-d01500138179 service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-23b26d99-5b01-4d02-818b-676d58e638ba req-f66a570b-a356-4f2e-9c78-d01500138179 service nova] Lock "68ef0023-a3cc-4441-8a7b-2cab2436f5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-23b26d99-5b01-4d02-818b-676d58e638ba req-f66a570b-a356-4f2e-9c78-d01500138179 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] No waiting events found dispatching network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:02 user nova-compute[74233]: WARNING nova.compute.manager [req-23b26d99-5b01-4d02-818b-676d58e638ba req-f66a570b-a356-4f2e-9c78-d01500138179 service nova] [instance: 68ef0023-a3cc-4441-8a7b-2cab2436f5d3] Received unexpected event network-vif-plugged-c77dedf5-6cfe-419a-b050-3759e6bce832 for instance with vm_state deleted and task_state None.
Oct 20 18:31:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:05 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.008s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:31:06 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:31:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8436MB free_disk=25.127525329589844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f8ba938f-246b-41d5-ab0f-30a41d148f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance b846b73b-60c6-494f-b016-fccc18b6c15f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:31:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:31:10 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:31:10 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:31:10 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:31:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:31:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:31:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Skipping network cache update for instance because it is being deleted. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'flavor' on Instance uuid b846b73b-60c6-494f-b016-fccc18b6c15f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e53baf6c-0047-4b3f-b487-de44fb0a2d86 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.408s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 34.274s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:15 user nova-compute[74233]: INFO nova.compute.manager [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Terminating instance
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-53501757-80dc-4700-beb4-5ce56b533c4b req-01de76dc-2eff-40d6-aa18-ad9acffff267 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-vif-unplugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-53501757-80dc-4700-beb4-5ce56b533c4b req-01de76dc-2eff-40d6-aa18-ad9acffff267 service nova] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-53501757-80dc-4700-beb4-5ce56b533c4b req-01de76dc-2eff-40d6-aa18-ad9acffff267 service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-53501757-80dc-4700-beb4-5ce56b533c4b req-01de76dc-2eff-40d6-aa18-ad9acffff267 service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-53501757-80dc-4700-beb4-5ce56b533c4b req-01de76dc-2eff-40d6-aa18-ad9acffff267 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] No waiting events found dispatching network-vif-unplugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-53501757-80dc-4700-beb4-5ce56b533c4b req-01de76dc-2eff-40d6-aa18-ad9acffff267 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-vif-unplugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [{"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-dc2ea472-32aa-44bb-90e1-03062a4ec3f4" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:31:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Instance destroyed successfully.
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lazy-loading 'resources' on Instance uuid b846b73b-60c6-494f-b016-fccc18b6c15f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-103382139',display_name='tempest-VolumesSnapshotTestJSON-instance-103382139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-103382139',id=37,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGzeO0v4jR1FXJqeG6u5W1tuRMJaqwOObk8Mj6bH3PwoflAu7CNMnuTkhfrbM6Y6mIX5R6nI5I86cXVKODunRMNwRMhUbVdN/zqeas5pWkxxdPAUlHpoeMkkYKjLMPxKA==',key_name='tempest-keypair-1762408118',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:27:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9b3d85046f4cf78cd79703b467f80e',ramdisk_id='',reservation_id='r-ep230ql1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1067753256',owner_user_name='tempest-VolumesSnapshotTestJSON-1067753256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d29b4bd2074808898ec96be8e0e471',uuid=b846b73b-60c6-494f-b016-fccc18b6c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converting VIF {"id": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "address": "fa:16:3e:2c:eb:73", "network": {"id": "aec8632f-aedc-4522-9223-9cccd18c29e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-790358883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9b3d85046f4cf78cd79703b467f80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a0e54e-1f", "ovs_interfaceid": "b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_vif [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8a0e54e-1f, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8297667-d680-4590-bfdf-89b5ec18ca22) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:16 user nova-compute[74233]: INFO os_vif [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:eb:73,bridge_name='br-int',has_traffic_filtering=True,id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92,network=Network(aec8632f-aedc-4522-9223-9cccd18c29e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a0e54e-1f')
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:88424e8a-d3f9-49c0-84ec-a46efd95b552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSOEiDUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:31:16 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[39ecbc80-3be5-46d6-9368-cc6e6ea9091b]: Unexpected error while running command.
Oct 20 18:31:16 user nova-compute[74233]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 18:31:16 user nova-compute[74233]: Exit code: 21
Oct 20 18:31:16 user nova-compute[74233]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 18:31:16 user nova-compute[74233]: Stderr: '' {{(pid=85316) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 18:31:16 user nova-compute[74233]: Traceback (most recent call last):
Oct 20 18:31:16 user nova-compute[74233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 18:31:16 user nova-compute[74233]:     ret = func(*f_args, **f_kwargs)
Oct 20 18:31:16 user nova-compute[74233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 18:31:16 user nova-compute[74233]:     return func(*args, **kwargs)
Oct 20 18:31:16 user nova-compute[74233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 18:31:16 user nova-compute[74233]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 18:31:16 user nova-compute[74233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 18:31:16 user nova-compute[74233]:     return putils.execute(on_execute=on_execute,
Oct 20 18:31:16 user nova-compute[74233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 18:31:16 user nova-compute[74233]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 18:31:16 user nova-compute[74233]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 18:31:16 user nova-compute[74233]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 18:31:16 user nova-compute[74233]: Exit code: 21
Oct 20 18:31:16 user nova-compute[74233]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 18:31:16 user nova-compute[74233]: Stderr: ''
Oct 20 18:31:16 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ecbc80-3be5-46d6-9368-cc6e6ea9091b]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 18:31:16 user nova-compute[74233]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 18:31:16 user nova-compute[74233]: Exit code: 21
Oct 20 18:31:16 user nova-compute[74233]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 18:31:16 user nova-compute[74233]: Stderr: ''
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 18:31:16 user nova-compute[74233]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74233) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.040s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] <== disconnect_volume: return (41ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:31:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Deleting instance files /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f_del
Oct 20 18:31:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Deletion of /opt/stack/data/nova/instances/b846b73b-60c6-494f-b016-fccc18b6c15f_del complete
Oct 20 18:31:16 user nova-compute[74233]: INFO nova.compute.manager [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 20 18:31:16 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:31:16 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Took 0.89 seconds to deallocate network for instance.
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-2e82e5c8-5d13-4d43-bc29-03d0095da860 req-28c67c8e-11b5-432b-b201-d2b45edb23fb service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-vif-deleted-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.compute.manager [req-2e82e5c8-5d13-4d43-bc29-03d0095da860 req-28c67c8e-11b5-432b-b201-d2b45edb23fb service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Neutron deleted interface b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92; detaching it from the instance and deleting it from the info cache
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.network.neutron [req-2e82e5c8-5d13-4d43-bc29-03d0095da860 req-28c67c8e-11b5-432b-b201-d2b45edb23fb service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:17 user nova-compute[74233]: WARNING nova.volume.cinder [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Attachment f73c0279-dcdf-4cb0-98b9-411198ffd000 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f73c0279-dcdf-4cb0-98b9-411198ffd000. (HTTP 404) (Request-ID: req-1210287e-ca08-43e9-a130-6b09889b8ac0)
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.compute.manager [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-2e82e5c8-5d13-4d43-bc29-03d0095da860 req-28c67c8e-11b5-432b-b201-d2b45edb23fb service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Detach interface failed, port_id=b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92, reason: Instance b846b73b-60c6-494f-b016-fccc18b6c15f could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.compute.claims [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Claim successful on node user
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.307s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-220d0645-a79e-475a-bb28-2a945b7d0684 req-2d40a422-449b-4955-8090-b15f329c1889 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received event network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-220d0645-a79e-475a-bb28-2a945b7d0684 req-2d40a422-449b-4955-8090-b15f329c1889 service nova] Acquiring lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-220d0645-a79e-475a-bb28-2a945b7d0684 req-2d40a422-449b-4955-8090-b15f329c1889 service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-220d0645-a79e-475a-bb28-2a945b7d0684 req-2d40a422-449b-4955-8090-b15f329c1889 service nova] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-220d0645-a79e-475a-bb28-2a945b7d0684 req-2d40a422-449b-4955-8090-b15f329c1889 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] No waiting events found dispatching network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:17 user nova-compute[74233]: WARNING nova.compute.manager [req-220d0645-a79e-475a-bb28-2a945b7d0684 req-2d40a422-449b-4955-8090-b15f329c1889 service nova] [instance: b846b73b-60c6-494f-b016-fccc18b6c15f] Received unexpected event network-vif-plugged-b8a0e54e-1f32-4dc4-8f89-c60cab8cbb92 for instance with vm_state deleted and task_state None.
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.network.neutron [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.policy [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd132de50b442419e8f3a059e650902e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0083be86b8f04d16a891eadad4dccbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.virt.block_device [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Booting with volume bb296a67-61a6-4156-86a3-a61d30c130b3 at /dev/vda
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG os_brick.utils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c35f3e-3bb8-4e1a-b47c-94c0c205944a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdee024-7d2c-4ee6-9dd3-85c0b40dca97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:17 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Deleted allocations for instance b846b73b-60c6-494f-b016-fccc18b6c15f
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebfa3e4-db54-49ed-8f5b-ec4fb2964ba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2880d8ac-ee64-4a5d-a4cb-d7b92c1a3327]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:31:17 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:31:17 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12333e61-fa92-4340-b138-472cedcbf1fb]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG os_brick.utils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating existing volume attachment record: 876220a5-7d3a-41c7-b4f9-68beb6f9a4bf {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b172f59d-b00a-4ef1-9c97-1238b7945ef3 tempest-VolumesSnapshotTestJSON-1067753256 tempest-VolumesSnapshotTestJSON-1067753256-project-member] Lock "b846b73b-60c6-494f-b016-fccc18b6c15f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Successfully created port: 43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Successfully updated port: 43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-changed-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Refreshing instance network info cache due to event network-changed-43351121-9b87-4f80-be17-6f02244b4ae4. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance network_info: |[{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Refreshing network info cache for port 43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updated VIF entry in instance network info cache for port 43351121-9b87-4f80-be17-6f02244b4ae4. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG nova.network.neutron [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-1ce9b78f-e8ff-40ad-b223-54e939ca6f8f req-763ebc29-afc0-413c-b81c-e3e296686e7d service nova] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:31:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:22 user nova-compute[74233]: INFO nova.compute.manager [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Terminating instance
Oct 20 18:31:22 user nova-compute[74233]: DEBUG nova.compute.manager [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.compute.manager [req-bcb2dc48-9238-434a-a5e5-7ce51a80b80c req-e820005d-940f-4a79-b4cd-c9f7280230c7 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-unplugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bcb2dc48-9238-434a-a5e5-7ce51a80b80c req-e820005d-940f-4a79-b4cd-c9f7280230c7 service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bcb2dc48-9238-434a-a5e5-7ce51a80b80c req-e820005d-940f-4a79-b4cd-c9f7280230c7 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bcb2dc48-9238-434a-a5e5-7ce51a80b80c req-e820005d-940f-4a79-b4cd-c9f7280230c7 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.compute.manager [req-bcb2dc48-9238-434a-a5e5-7ce51a80b80c req-e820005d-940f-4a79-b4cd-c9f7280230c7 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-unplugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.compute.manager [req-bcb2dc48-9238-434a-a5e5-7ce51a80b80c req-e820005d-940f-4a79-b4cd-c9f7280230c7 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-unplugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Instance destroyed successfully.
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.objects.instance [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'resources' on Instance uuid f8ba938f-246b-41d5-ab0f-30a41d148f1f {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1831294329',display_name='tempest-ServerRescueNegativeTestJSON-server-1831294329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1831294329',id=22,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:16:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-s8wlcmb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:16:33Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=f8ba938f-246b-41d5-ab0f-30a41d148f1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "address": "fa:16:3e:87:ba:a3", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae1063f-fe", "ovs_interfaceid": "5ae1063f-fe60-46cb-ad70-65daa8b58493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG os_vif [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ae1063f-fe, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=906583f5-1848-46c5-9a16-5d36996054d1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:23 user nova-compute[74233]: INFO os_vif [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:ba:a3,bridge_name='br-int',has_traffic_filtering=True,id=5ae1063f-fe60-46cb-ad70-65daa8b58493,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae1063f-fe')
Oct 20 18:31:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Deleting instance files /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f_del
Oct 20 18:31:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Deletion of /opt/stack/data/nova/instances/f8ba938f-246b-41d5-ab0f-30a41d148f1f_del complete
Oct 20 18:31:23 user nova-compute[74233]: INFO nova.compute.manager [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 20 18:31:23 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:31:23 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:31:24 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:24 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Took 0.40 seconds to deallocate network for instance.
Oct 20 18:31:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-67a2b812-e824-4dd6-8134-c3ac3b611812 req-976a3771-4ea5-4595-ada2-248b57adfb4b service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-deleted-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:24 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:31:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:31:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:24 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Deleted allocations for instance f8ba938f-246b-41d5-ab0f-30a41d148f1f
Oct 20 18:31:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-7c95870c-a309-4abe-982f-09a6296fa9f9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.877s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-896e4912-c6e6-4a03-9444-ccb73c46fa12 req-93faada5-5fd8-4f94-a5d9-caeb686ee316 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-896e4912-c6e6-4a03-9444-ccb73c46fa12 req-93faada5-5fd8-4f94-a5d9-caeb686ee316 service nova] Acquiring lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-896e4912-c6e6-4a03-9444-ccb73c46fa12 req-93faada5-5fd8-4f94-a5d9-caeb686ee316 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-896e4912-c6e6-4a03-9444-ccb73c46fa12 req-93faada5-5fd8-4f94-a5d9-caeb686ee316 service nova] Lock "f8ba938f-246b-41d5-ab0f-30a41d148f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-896e4912-c6e6-4a03-9444-ccb73c46fa12 req-93faada5-5fd8-4f94-a5d9-caeb686ee316 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] No waiting events found dispatching network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:25 user nova-compute[74233]: WARNING nova.compute.manager [req-896e4912-c6e6-4a03-9444-ccb73c46fa12 req-93faada5-5fd8-4f94-a5d9-caeb686ee316 service nova] [instance: f8ba938f-246b-41d5-ab0f-30a41d148f1f] Received unexpected event network-vif-plugged-5ae1063f-fe60-46cb-ad70-65daa8b58493 for instance with vm_state deleted and task_state None.
Oct 20 18:31:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:31:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Creating image(s)
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Ensure instance console log exists: /opt/stack/data/nova/instances/312f41b0-e549-4b33-be6f-350ec8f8f708/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Start _get_guest_xml network_info=[{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '876220a5-7d3a-41c7-b4f9-68beb6f9a4bf', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '312f41b0-e549-4b33-be6f-350ec8f8f708', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb296a67-61a6-4156-86a3-a61d30c130b3', 'serial': 'bb296a67-61a6-4156-86a3-a61d30c130b3'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:31:35 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:31:35 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:31:35 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:31:35 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:31:35 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c00856-c327-467c-b049-85b0c8e6175f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:31:35 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ee775-61d2-409e-840e-99783ac12370]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3] added
Oct 20 18:31:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636fbc4-8561-492c-bdb4-e9a249f30aa0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9310c64b-bb6d-4751-a666-b1d3712a6f3d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlXgJQZh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlXgJQZh" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[044acf05-bd7f-40b7-912e-9df575b6145b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlXgJQZh'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[101b49cf-f01b-41cf-b9f2-2126b61e1361]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc4fef1-1b8d-4c8e-889a-552f4530ed6b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412b75e7-6be9-441b-980c-7f07fc97cc55 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412b75e7-6be9-441b-980c-7f07fc97cc55 (non-flash)
Oct 20 18:31:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412b75e7-6be9-441b-980c-7f07fc97cc55 (non-flash)
Oct 20 18:31:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b18c41-21db-420e-9843-4360d7abb8f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]
Oct 20 18:31:35 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.
Oct 20 18:31:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eac0cb-dba8-4aa9-9a6e-3e19ff34e4ed]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d4185-35d7-46ed-af94-d445a53e4a4d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412b75e7-6be9-441b-980c-7f07fc97cc55 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412b75e7-6be9-441b-980c-7f07fc97cc55 (non-flash)
Oct 20 18:31:35 user nova-compute[74233]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:31:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412b75e7-6be9-441b-980c-7f07fc97cc55 (non-flash)
Oct 20 18:31:35 user nova-compute[74233]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:31:35 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff9f55-1614-4c61-93fe-a1b440b7ae56]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:31:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23462656530343465', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462656530343465', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-525089166',display_name='tempest-ServerActionsTestOtherA-server-525089166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-525089166',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-9gjpigga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=312f41b0-e549-4b33-be6f-350ec8f8f708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.objects.instance [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'pci_devices' on Instance uuid 312f41b0-e549-4b33-be6f-350ec8f8f708 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:31:36 user nova-compute[74233]:   <uuid>312f41b0-e549-4b33-be6f-350ec8f8f708</uuid>
Oct 20 18:31:36 user nova-compute[74233]:   <name>instance-00000028</name>
Oct 20 18:31:36 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:31:36 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:31:36 user nova-compute[74233]:   <metadata>
Oct 20 18:31:36 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:31:36 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:31:36 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherA-server-525089166</nova:name>
Oct 20 18:31:36 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:31:35</nova:creationTime>
Oct 20 18:31:36 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:31:36 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:31:36 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:31:36 user nova-compute[74233]:       <nova:owner>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:user uuid="d132de50b442419e8f3a059e650902e7">tempest-ServerActionsTestOtherA-835796467-project-member</nova:user>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:project uuid="0083be86b8f04d16a891eadad4dccbe6">tempest-ServerActionsTestOtherA-835796467</nova:project>
Oct 20 18:31:36 user nova-compute[74233]:       </nova:owner>
Oct 20 18:31:36 user nova-compute[74233]:       <nova:ports>
Oct 20 18:31:36 user nova-compute[74233]:         <nova:port uuid="43351121-9b87-4f80-be17-6f02244b4ae4">
Oct 20 18:31:36 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:31:36 user nova-compute[74233]:         </nova:port>
Oct 20 18:31:36 user nova-compute[74233]:       </nova:ports>
Oct 20 18:31:36 user nova-compute[74233]:     </nova:instance>
Oct 20 18:31:36 user nova-compute[74233]:   </metadata>
Oct 20 18:31:36 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:31:36 user nova-compute[74233]:     <system>
Oct 20 18:31:36 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:31:36 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:31:36 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:31:36 user nova-compute[74233]:       <entry name="serial">312f41b0-e549-4b33-be6f-350ec8f8f708</entry>
Oct 20 18:31:36 user nova-compute[74233]:       <entry name="uuid">312f41b0-e549-4b33-be6f-350ec8f8f708</entry>
Oct 20 18:31:36 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:31:36 user nova-compute[74233]:     </system>
Oct 20 18:31:36 user nova-compute[74233]:   </sysinfo>
Oct 20 18:31:36 user nova-compute[74233]:   <os>
Oct 20 18:31:36 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:31:36 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:31:36 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:31:36 user nova-compute[74233]:   </os>
Oct 20 18:31:36 user nova-compute[74233]:   <features>
Oct 20 18:31:36 user nova-compute[74233]:     <acpi/>
Oct 20 18:31:36 user nova-compute[74233]:     <apic/>
Oct 20 18:31:36 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:31:36 user nova-compute[74233]:   </features>
Oct 20 18:31:36 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:31:36 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:31:36 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:31:36 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:31:36 user nova-compute[74233]:   </clock>
Oct 20 18:31:36 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:31:36 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:31:36 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:31:36 user nova-compute[74233]:   </cpu>
Oct 20 18:31:36 user nova-compute[74233]:   <devices>
Oct 20 18:31:36 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:31:36 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:31:36 user nova-compute[74233]:       <source dev="/dev/sdc"/>
Oct 20 18:31:36 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:31:36 user nova-compute[74233]:       <serial>bb296a67-61a6-4156-86a3-a61d30c130b3</serial>
Oct 20 18:31:36 user nova-compute[74233]:     </disk>
Oct 20 18:31:36 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:31:36 user nova-compute[74233]:       <mac address="fa:16:3e:9e:42:69"/>
Oct 20 18:31:36 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:31:36 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:31:36 user nova-compute[74233]:       <target dev="tap43351121-9b"/>
Oct 20 18:31:36 user nova-compute[74233]:     </interface>
Oct 20 18:31:36 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:31:36 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/312f41b0-e549-4b33-be6f-350ec8f8f708/console.log" append="off"/>
Oct 20 18:31:36 user nova-compute[74233]:     </serial>
Oct 20 18:31:36 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:31:36 user nova-compute[74233]:     <video>
Oct 20 18:31:36 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:31:36 user nova-compute[74233]:     </video>
Oct 20 18:31:36 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:31:36 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:31:36 user nova-compute[74233]:     </rng>
Oct 20 18:31:36 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:31:36 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:31:36 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:31:36 user nova-compute[74233]:     </memballoon>
Oct 20 18:31:36 user nova-compute[74233]:   </devices>
Oct 20 18:31:36 user nova-compute[74233]: </domain>
Oct 20 18:31:36 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-525089166',display_name='tempest-ServerActionsTestOtherA-server-525089166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-525089166',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-9gjpigga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=312f41b0-e549-4b33-be6f-350ec8f8f708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG os_vif [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17cb4d6c-d50a-5ae2-a92f-86c4851c786b', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43351121-9b, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43351121-9b, col_values=(('qos', UUID('7a2dc19e-76ce-4db1-a0d9-801178e6fdc0')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43351121-9b, col_values=(('external_ids', {'iface-id': '43351121-9b87-4f80-be17-6f02244b4ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:42:69', 'vm-uuid': '312f41b0-e549-4b33-be6f-350ec8f8f708'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:36 user nova-compute[74233]: INFO os_vif [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b')
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:31:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No VIF found with MAC fa:16:3e:9e:42:69, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-fb9e83aa-3e0b-4236-8e71-c65cbfb96eb9 req-ea9fdcb6-eee3-46a4-9700-ca7c2fa43556 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fb9e83aa-3e0b-4236-8e71-c65cbfb96eb9 req-ea9fdcb6-eee3-46a4-9700-ca7c2fa43556 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fb9e83aa-3e0b-4236-8e71-c65cbfb96eb9 req-ea9fdcb6-eee3-46a4-9700-ca7c2fa43556 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fb9e83aa-3e0b-4236-8e71-c65cbfb96eb9 req-ea9fdcb6-eee3-46a4-9700-ca7c2fa43556 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-fb9e83aa-3e0b-4236-8e71-c65cbfb96eb9 req-ea9fdcb6-eee3-46a4-9700-ca7c2fa43556 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:38 user nova-compute[74233]: WARNING nova.compute.manager [req-fb9e83aa-3e0b-4236-8e71-c65cbfb96eb9 req-ea9fdcb6-eee3-46a4-9700-ca7c2fa43556 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state building and task_state spawning.
Oct 20 18:31:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-a39c6604-8c68-491b-93bd-b9a553f3e8c4 req-f75f397d-80a0-4d63-b729-2b1d88b5f2b5 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a39c6604-8c68-491b-93bd-b9a553f3e8c4 req-f75f397d-80a0-4d63-b729-2b1d88b5f2b5 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a39c6604-8c68-491b-93bd-b9a553f3e8c4 req-f75f397d-80a0-4d63-b729-2b1d88b5f2b5 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a39c6604-8c68-491b-93bd-b9a553f3e8c4 req-f75f397d-80a0-4d63-b729-2b1d88b5f2b5 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-a39c6604-8c68-491b-93bd-b9a553f3e8c4 req-f75f397d-80a0-4d63-b729-2b1d88b5f2b5 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:40 user nova-compute[74233]: WARNING nova.compute.manager [req-a39c6604-8c68-491b-93bd-b9a553f3e8c4 req-f75f397d-80a0-4d63-b729-2b1d88b5f2b5 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state building and task_state spawning.
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:31:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance spawned successfully.
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:31:40 user nova-compute[74233]: INFO nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 20 18:31:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:31:40 user nova-compute[74233]: INFO nova.compute.manager [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Took 23.38 seconds to build instance.
Oct 20 18:31:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-894d5e0c-914a-4bb5-a9a8-2f3ff70c5907 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.502s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:31:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:31:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:31:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:54 user nova-compute[74233]: INFO nova.compute.manager [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Terminating instance
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-d76967c2-641b-496f-81e6-77fab238f45a req-fd9d582f-a162-4620-b897-f508f772ad0a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-vif-unplugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d76967c2-641b-496f-81e6-77fab238f45a req-fd9d582f-a162-4620-b897-f508f772ad0a service nova] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d76967c2-641b-496f-81e6-77fab238f45a req-fd9d582f-a162-4620-b897-f508f772ad0a service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d76967c2-641b-496f-81e6-77fab238f45a req-fd9d582f-a162-4620-b897-f508f772ad0a service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-d76967c2-641b-496f-81e6-77fab238f45a req-fd9d582f-a162-4620-b897-f508f772ad0a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] No waiting events found dispatching network-vif-unplugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-d76967c2-641b-496f-81e6-77fab238f45a req-fd9d582f-a162-4620-b897-f508f772ad0a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-vif-unplugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Instance destroyed successfully.
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.objects.instance [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lazy-loading 'resources' on Instance uuid 362fb740-c18c-44f7-a034-ff26f2d1d588 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-32273927',display_name='tempest-SnapshotDataIntegrityTests-server-32273927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-32273927',id=33,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhXFMAOUNAJu33WxfpHsvesKNVem+XIID7i6NZXLeBeMYzoVs7R+xdkhUpufVetpU4m9O08gpQT0OFr1F7ZiQRxlzly6lLrB7aiCjr8KV6Zv6RXCGYO2kSueVv2tgjyow==',key_name='tempest-keypair-1054100320',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='581bb97db0e34d669a02e48524574e09',ramdisk_id='',reservation_id='r-liev30ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1105034583',owner_user_name='tempest-SnapshotDataIntegrityTests-1105034583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4890b8a259c742de8e6ac402143f38cb',uuid=362fb740-c18c-44f7-a034-ff26f2d1d588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Converting VIF {"id": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "address": "fa:16:3e:74:9a:63", "network": {"id": "bb56c4b7-33b9-4c0e-9923-9e27069e0de1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-145837424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "581bb97db0e34d669a02e48524574e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02fb71a-88", "ovs_interfaceid": "d02fb71a-88f4-47ad-9ac4-3e2609efaeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG os_vif [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd02fb71a-88, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c5f4c82-5a63-4b43-82c7-4442840e5244) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:54 user nova-compute[74233]: INFO os_vif [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac,network=Network(bb56c4b7-33b9-4c0e-9923-9e27069e0de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02fb71a-88')
Oct 20 18:31:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Deleting instance files /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588_del
Oct 20 18:31:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Deletion of /opt/stack/data/nova/instances/362fb740-c18c-44f7-a034-ff26f2d1d588_del complete
Oct 20 18:31:55 user nova-compute[74233]: INFO nova.compute.manager [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 20 18:31:55 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:31:55 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:31:55 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:31:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:31:55 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:56 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Took 0.90 seconds to deallocate network for instance.
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-514bd94b-a028-44ea-a4ab-9ffae10da4fd req-e8f19d94-d087-4169-9844-f431a70fbb9a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-vif-deleted-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:56 user nova-compute[74233]: INFO nova.compute.manager [req-514bd94b-a028-44ea-a4ab-9ffae10da4fd req-e8f19d94-d087-4169-9844-f431a70fbb9a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Neutron deleted interface d02fb71a-88f4-47ad-9ac4-3e2609efaeac; detaching it from the instance and deleting it from the info cache
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.network.neutron [req-514bd94b-a028-44ea-a4ab-9ffae10da4fd req-e8f19d94-d087-4169-9844-f431a70fbb9a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-514bd94b-a028-44ea-a4ab-9ffae10da4fd req-e8f19d94-d087-4169-9844-f431a70fbb9a service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Detach interface failed, port_id=d02fb71a-88f4-47ad-9ac4-3e2609efaeac, reason: Instance 362fb740-c18c-44f7-a034-ff26f2d1d588 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:56 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Deleted allocations for instance 362fb740-c18c-44f7-a034-ff26f2d1d588
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ac6d4b1-f72f-4c3d-8e98-5d5cae9f615e req-f4789254-46e7-4d54-ace4-f7dd38c64153 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received event network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ac6d4b1-f72f-4c3d-8e98-5d5cae9f615e req-f4789254-46e7-4d54-ace4-f7dd38c64153 service nova] Acquiring lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ac6d4b1-f72f-4c3d-8e98-5d5cae9f615e req-f4789254-46e7-4d54-ace4-f7dd38c64153 service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ac6d4b1-f72f-4c3d-8e98-5d5cae9f615e req-f4789254-46e7-4d54-ace4-f7dd38c64153 service nova] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ac6d4b1-f72f-4c3d-8e98-5d5cae9f615e req-f4789254-46e7-4d54-ace4-f7dd38c64153 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] No waiting events found dispatching network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:31:56 user nova-compute[74233]: WARNING nova.compute.manager [req-8ac6d4b1-f72f-4c3d-8e98-5d5cae9f615e req-f4789254-46e7-4d54-ace4-f7dd38c64153 service nova] [instance: 362fb740-c18c-44f7-a034-ff26f2d1d588] Received unexpected event network-vif-plugged-d02fb71a-88f4-47ad-9ac4-3e2609efaeac for instance with vm_state deleted and task_state None.
Oct 20 18:31:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-50f79140-69f9-4c7b-8550-6b5b02488143 tempest-SnapshotDataIntegrityTests-1105034583 tempest-SnapshotDataIntegrityTests-1105034583-project-member] Lock "362fb740-c18c-44f7-a034-ff26f2d1d588" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:31:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:31:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:04 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:32:07 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:32:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:32:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:32:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8474MB free_disk=25.199966430664062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 312f41b0-e549-4b33-be6f-350ec8f8f708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:32:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:13 user nova-compute[74233]: INFO nova.compute.manager [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Terminating instance
Oct 20 18:32:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-e256a578-52fb-4769-a96e-9fdf81ae07d0 req-05cc825b-9e37-468a-ab96-fbc68dfc4145 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e256a578-52fb-4769-a96e-9fdf81ae07d0 req-05cc825b-9e37-468a-ab96-fbc68dfc4145 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e256a578-52fb-4769-a96e-9fdf81ae07d0 req-05cc825b-9e37-468a-ab96-fbc68dfc4145 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e256a578-52fb-4769-a96e-9fdf81ae07d0 req-05cc825b-9e37-468a-ab96-fbc68dfc4145 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-e256a578-52fb-4769-a96e-9fdf81ae07d0 req-05cc825b-9e37-468a-ab96-fbc68dfc4145 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:32:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-e256a578-52fb-4769-a96e-9fdf81ae07d0 req-05cc825b-9e37-468a-ab96-fbc68dfc4145 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-unplugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:32:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Instance destroyed successfully.
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.objects.instance [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lazy-loading 'resources' on Instance uuid dc2ea472-32aa-44bb-90e1-03062a4ec3f4 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1201958767',display_name='tempest-ServerRescueNegativeTestJSON-server-1201958767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1201958767',id=21,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e847f3ff044181bb615138361ec8da',ramdisk_id='',reservation_id='r-np33292u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226182355',owner_user_name='tempest-ServerRescueNegativeTestJSON-226182355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:21:21Z,user_data=None,user_id='15b21695cdfe4b4299fb08403ed15ddd',uuid=dc2ea472-32aa-44bb-90e1-03062a4ec3f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converting VIF {"id": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "address": "fa:16:3e:0a:67:00", "network": {"id": "b9065765-58ee-465f-8e30-ed9f3a98cab9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1967240677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e847f3ff044181bb615138361ec8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb255a80-de", "ovs_interfaceid": "fb255a80-de0b-488a-b67a-946e1bd3dc98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG os_vif [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb255a80-de, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6f2aa30-b6f9-44e2-986a-b578afa3d636) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:14 user nova-compute[74233]: INFO os_vif [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:67:00,bridge_name='br-int',has_traffic_filtering=True,id=fb255a80-de0b-488a-b67a-946e1bd3dc98,network=Network(b9065765-58ee-465f-8e30-ed9f3a98cab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb255a80-de')
Oct 20 18:32:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Deleting instance files /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4_del
Oct 20 18:32:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Deletion of /opt/stack/data/nova/instances/dc2ea472-32aa-44bb-90e1-03062a4ec3f4_del complete
Oct 20 18:32:14 user nova-compute[74233]: INFO nova.compute.manager [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 18:32:14 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:32:14 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Took 0.45 seconds to deallocate network for instance.
Oct 20 18:32:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.compute.manager [req-0bc91630-b762-4a3a-999b-0cff1f327842 req-fbd57a87-f0c4-4872-9315-23a0425e974c service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-deleted-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:32:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:14 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Deleted allocations for instance dc2ea472-32aa-44bb-90e1-03062a4ec3f4
Oct 20 18:32:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-58124f9c-1804-4d28-a918-244f7aacc9d9 tempest-ServerRescueNegativeTestJSON-226182355 tempest-ServerRescueNegativeTestJSON-226182355-project-member] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.758s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0e8680d-8772-4b7d-aa90-e9cae047022d req-11a47d74-d540-4cc5-a28f-503a21b32043 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:32:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0e8680d-8772-4b7d-aa90-e9cae047022d req-11a47d74-d540-4cc5-a28f-503a21b32043 service nova] Acquiring lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0e8680d-8772-4b7d-aa90-e9cae047022d req-11a47d74-d540-4cc5-a28f-503a21b32043 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0e8680d-8772-4b7d-aa90-e9cae047022d req-11a47d74-d540-4cc5-a28f-503a21b32043 service nova] Lock "dc2ea472-32aa-44bb-90e1-03062a4ec3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0e8680d-8772-4b7d-aa90-e9cae047022d req-11a47d74-d540-4cc5-a28f-503a21b32043 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] No waiting events found dispatching network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:32:15 user nova-compute[74233]: WARNING nova.compute.manager [req-a0e8680d-8772-4b7d-aa90-e9cae047022d req-11a47d74-d540-4cc5-a28f-503a21b32043 service nova] [instance: dc2ea472-32aa-44bb-90e1-03062a4ec3f4] Received unexpected event network-vif-plugged-fb255a80-de0b-488a-b67a-946e1bd3dc98 for instance with vm_state deleted and task_state None.
Oct 20 18:32:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:16 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:32:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:32:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:32:16 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:32:17 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:32:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:32:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:32:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:32:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:32:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:32:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:32:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:32:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:32:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:32:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:32:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:32:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:53 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 9d8f3218-2a57-452f-8251-2d5591c9f09a {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 312f41b0-e549-4b33-be6f-350ec8f8f708 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:32:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:32:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:32:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:32:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:32:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:32:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-changed-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Refreshing instance network info cache due to event network-changed-6d5340b7-026b-4367-bf48-c710ffca8ace. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Refreshing network info cache for port 6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated VIF entry in instance network info cache for port 6d5340b7-026b-4367-bf48-c710ffca8ace. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.network.neutron [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7e4dbfc8-cd32-4e34-9802-4fdf4ddc210f req-0ac55754-bddf-436d-8b52-05032033ab36 service nova] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:33:08 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:33:09 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:33:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8750MB free_disk=25.223960876464844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:09 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating resource usage from migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed
Oct 20 18:33:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:33:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-changed-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Refreshing instance network info cache due to event network-changed-43351121-9b87-4f80-be17-6f02244b4ae4. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Refreshing network info cache for port 43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Stashing vm_state: active {{(pid=74233) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:33:10 user nova-compute[74233]: INFO nova.compute.claims [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Claim successful on node user
Oct 20 18:33:10 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating resource usage from migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.269s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:10 user nova-compute[74233]: INFO nova.compute.manager [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Migrating
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updated VIF entry in instance network info cache for port 43351121-9b87-4f80-be17-6f02244b4ae4. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a8635ce6-f852-4685-9f10-ab4e1043e5ae req-143ef399-4d70-4583-90fe-fc0df57bd444 service nova] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:33:10 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Starting migrate_disk_and_power_off {{(pid=74233) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-eedbd978-b5f4-4cfe-a085-7357468ef166 req-a9f3c48c-a51e-4dec-916c-41945a28420a service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eedbd978-b5f4-4cfe-a085-7357468ef166 req-a9f3c48c-a51e-4dec-916c-41945a28420a service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eedbd978-b5f4-4cfe-a085-7357468ef166 req-a9f3c48c-a51e-4dec-916c-41945a28420a service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-eedbd978-b5f4-4cfe-a085-7357468ef166 req-a9f3c48c-a51e-4dec-916c-41945a28420a service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-eedbd978-b5f4-4cfe-a085-7357468ef166 req-a9f3c48c-a51e-4dec-916c-41945a28420a service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:33:11 user nova-compute[74233]: WARNING nova.compute.manager [req-eedbd978-b5f4-4cfe-a085-7357468ef166 req-a9f3c48c-a51e-4dec-916c-41945a28420a service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state resize_migrating.
Oct 20 18:33:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance destroyed successfully.
Oct 20 18:33:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-525089166',display_name='tempest-ServerActionsTestOtherA-server-525089166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-525089166',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-9gjpigga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=312f41b0-e549-4b33-be6f-350ec8f8f708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43351121-9b, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a2dc19e-76ce-4db1-a0d9-801178e6fdc0) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:33:12 user nova-compute[74233]: INFO os_vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b')
Oct 20 18:33:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:33:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b998f-c0ed-42de-9fff-0f9ca880a9ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:33:12 user nova-compute[74233]: No targets found.
Oct 20 18:33:12 user nova-compute[74233]: iSNS:
Oct 20 18:33:12 user nova-compute[74233]: No targets found.
Oct 20 18:33:12 user nova-compute[74233]: STATIC:
Oct 20 18:33:12 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3
Oct 20 18:33:12 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:33:12 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:33:12 user nova-compute[74233]: FIRMWARE:
Oct 20 18:33:12 user nova-compute[74233]: No targets found.
Oct 20 18:33:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:33:12 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:33:12 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4c8b2-36fa-4038-977d-b8638e255bde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e896d5-b6b1-4c69-88c9-775784449859]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:33:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:33:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970484700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ea55ee-5603-4e35-a14a-cd204781f21c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60332131-7f36-41e9-a448-ebf195d3b0e5]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b7148d-9df4-476a-a20f-6ae4e3e75556]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25cedea-9128-4c04-81b9-8196d6c67a1b]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8086e76e-4bee044eb53e724d', '/dev/disk/by-id/scsi-23462656530343465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8086e76e') {{(pid=85316) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a331facb-bcb8-494f-b0dc-62c95f8c9366]: (4, None) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e0cbca-1ecc-4a3b-a9f0-f54e29af39d2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac81a1de-59b2-420c-a41d-94c7edde65ea]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]
Oct 20 18:33:12 user nova-compute[74233]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.
Oct 20 18:33:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[172da566-a988-4a48-a358-4698e55811dd]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== disconnect_volume: return (339ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-8e286a9a-b8b0-47ee-9d30-1fb93e28e7ff req-760c016f-e51d-40b8-b0af-ba8a2badf5ae service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8e286a9a-b8b0-47ee-9d30-1fb93e28e7ff req-760c016f-e51d-40b8-b0af-ba8a2badf5ae service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8e286a9a-b8b0-47ee-9d30-1fb93e28e7ff req-760c016f-e51d-40b8-b0af-ba8a2badf5ae service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8e286a9a-b8b0-47ee-9d30-1fb93e28e7ff req-760c016f-e51d-40b8-b0af-ba8a2badf5ae service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-8e286a9a-b8b0-47ee-9d30-1fb93e28e7ff req-760c016f-e51d-40b8-b0af-ba8a2badf5ae service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:33:13 user nova-compute[74233]: WARNING nova.compute.manager [req-8e286a9a-b8b0-47ee-9d30-1fb93e28e7ff req-760c016f-e51d-40b8-b0af-ba8a2badf5ae service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state resize_migrating.
Oct 20 18:33:14 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Port 43351121-9b87-4f80-be17-6f02244b4ae4 binding to destination host user is already ACTIVE {{(pid=74233) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:33:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG os_brick.utils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc68f740-8a0f-4943-83ad-c5b93a7abd47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd7f61-0e2b-4bbe-878b-cf195339fd85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[197a1b34-81f4-4952-9efe-27f536004de9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f779b7f-0996-4268-bb4e-eea7582c01f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:33:15 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:33:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2e54d-f866-4492-bf1b-22cef4250106]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG os_brick.utils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:33:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:16 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:33:16 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:33:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:33:19 user nova-compute[74233]: INFO nova.compute.claims [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Claim successful on node user
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:33:19 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.policy [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd2c1848a2c437082490de2207c58b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e472b626ad43d8b1422b554b64b1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:33:19 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Creating image(s)
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk 1073741824" returned: 0 in 0.056s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG nova.network.neutron [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Successfully created port: 931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Cannot resize image /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Ensure instance console log exists: /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.neutron [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Successfully updated port: 931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.neutron [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing instance network info cache due to event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.neutron [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.neutron [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance network_info: |[{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.neutron [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Start _get_guest_xml network_info=[{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:33:21 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:33:21 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1393302681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1393302681',id=41,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4rklmJ1LGAqZWHX4SPY8EYpE9I39QL0J+AH8+zEwRZ/0B/bkgavKFtoka6akRq5raqRWRLP9Z8iaIGuwcJV9GHLODx0yR7Cq58Q3Li1bGzisL3e3an3Wr5/ovfXLTuA==',key_name='tempest-keypair-893393640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-fjkx79sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f0309a68-e7f9-4a0a-84ac-5bb0794315be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.objects.instance [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'pci_devices' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:33:21 user nova-compute[74233]:   <uuid>f0309a68-e7f9-4a0a-84ac-5bb0794315be</uuid>
Oct 20 18:33:21 user nova-compute[74233]:   <name>instance-00000029</name>
Oct 20 18:33:21 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:33:21 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:33:21 user nova-compute[74233]:   <metadata>
Oct 20 18:33:21 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:33:21 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:33:21 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1393302681</nova:name>
Oct 20 18:33:21 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:33:21</nova:creationTime>
Oct 20 18:33:21 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:33:21 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:33:21 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:33:21 user nova-compute[74233]:       <nova:owner>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:user uuid="efd2c1848a2c437082490de2207c58b7">tempest-AttachVolumeShelveTestJSON-97665862-project-member</nova:user>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:project uuid="92e472b626ad43d8b1422b554b64b1a9">tempest-AttachVolumeShelveTestJSON-97665862</nova:project>
Oct 20 18:33:21 user nova-compute[74233]:       </nova:owner>
Oct 20 18:33:21 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:33:21 user nova-compute[74233]:       <nova:ports>
Oct 20 18:33:21 user nova-compute[74233]:         <nova:port uuid="931fbf57-df65-4214-b135-c6a4be7374d3">
Oct 20 18:33:21 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:33:21 user nova-compute[74233]:         </nova:port>
Oct 20 18:33:21 user nova-compute[74233]:       </nova:ports>
Oct 20 18:33:21 user nova-compute[74233]:     </nova:instance>
Oct 20 18:33:21 user nova-compute[74233]:   </metadata>
Oct 20 18:33:21 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:33:21 user nova-compute[74233]:     <system>
Oct 20 18:33:21 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:33:21 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:33:21 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:33:21 user nova-compute[74233]:       <entry name="serial">f0309a68-e7f9-4a0a-84ac-5bb0794315be</entry>
Oct 20 18:33:21 user nova-compute[74233]:       <entry name="uuid">f0309a68-e7f9-4a0a-84ac-5bb0794315be</entry>
Oct 20 18:33:21 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:33:21 user nova-compute[74233]:     </system>
Oct 20 18:33:21 user nova-compute[74233]:   </sysinfo>
Oct 20 18:33:21 user nova-compute[74233]:   <os>
Oct 20 18:33:21 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:33:21 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:33:21 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:33:21 user nova-compute[74233]:   </os>
Oct 20 18:33:21 user nova-compute[74233]:   <features>
Oct 20 18:33:21 user nova-compute[74233]:     <acpi/>
Oct 20 18:33:21 user nova-compute[74233]:     <apic/>
Oct 20 18:33:21 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:33:21 user nova-compute[74233]:   </features>
Oct 20 18:33:21 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:33:21 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:33:21 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:33:21 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:33:21 user nova-compute[74233]:   </clock>
Oct 20 18:33:21 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:33:21 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:33:21 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:33:21 user nova-compute[74233]:   </cpu>
Oct 20 18:33:21 user nova-compute[74233]:   <devices>
Oct 20 18:33:21 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:33:21 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:33:21 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk"/>
Oct 20 18:33:21 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:33:21 user nova-compute[74233]:     </disk>
Oct 20 18:33:21 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:33:21 user nova-compute[74233]:       <mac address="fa:16:3e:a2:32:c6"/>
Oct 20 18:33:21 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:33:21 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:33:21 user nova-compute[74233]:       <target dev="tap931fbf57-df"/>
Oct 20 18:33:21 user nova-compute[74233]:     </interface>
Oct 20 18:33:21 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:33:21 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/console.log" append="off"/>
Oct 20 18:33:21 user nova-compute[74233]:     </serial>
Oct 20 18:33:21 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:33:21 user nova-compute[74233]:     <video>
Oct 20 18:33:21 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:33:21 user nova-compute[74233]:     </video>
Oct 20 18:33:21 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:33:21 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:33:21 user nova-compute[74233]:     </rng>
Oct 20 18:33:21 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:33:21 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:33:21 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:33:21 user nova-compute[74233]:     </memballoon>
Oct 20 18:33:21 user nova-compute[74233]:   </devices>
Oct 20 18:33:21 user nova-compute[74233]: </domain>
Oct 20 18:33:21 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1393302681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1393302681',id=41,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4rklmJ1LGAqZWHX4SPY8EYpE9I39QL0J+AH8+zEwRZ/0B/bkgavKFtoka6akRq5raqRWRLP9Z8iaIGuwcJV9GHLODx0yR7Cq58Q3Li1bGzisL3e3an3Wr5/ovfXLTuA==',key_name='tempest-keypair-893393640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-fjkx79sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f0309a68-e7f9-4a0a-84ac-5bb0794315be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG os_vif [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '744a1429-cbba-5226-9257-9f8229a106f6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap931fbf57-df, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap931fbf57-df, col_values=(('qos', UUID('06561f36-b783-4724-bc77-163d383a938d')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap931fbf57-df, col_values=(('external_ids', {'iface-id': '931fbf57-df65-4214-b135-c6a4be7374d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:32:c6', 'vm-uuid': 'f0309a68-e7f9-4a0a-84ac-5bb0794315be'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:33:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:21 user nova-compute[74233]: INFO os_vif [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df')
Oct 20 18:33:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:33:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No VIF found with MAC fa:16:3e:a2:32:c6, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:33:22 user nova-compute[74233]: DEBUG nova.network.neutron [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updated VIF entry in instance network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:33:22 user nova-compute[74233]: DEBUG nova.network.neutron [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:33:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ff1e092b-e0b0-44ac-9eb8-0dbf38368080 req-ea48713b-24dd-465e-a3ba-31e4340a6ec1 service nova] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:33:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-66383bcc-a0da-49b3-af67-4473370c5beb req-52d54e47-7bb2-44c2-b338-0cd178aaa7b1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-66383bcc-a0da-49b3-af67-4473370c5beb req-52d54e47-7bb2-44c2-b338-0cd178aaa7b1 service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-66383bcc-a0da-49b3-af67-4473370c5beb req-52d54e47-7bb2-44c2-b338-0cd178aaa7b1 service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-66383bcc-a0da-49b3-af67-4473370c5beb req-52d54e47-7bb2-44c2-b338-0cd178aaa7b1 service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-66383bcc-a0da-49b3-af67-4473370c5beb req-52d54e47-7bb2-44c2-b338-0cd178aaa7b1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:33:24 user nova-compute[74233]: WARNING nova.compute.manager [req-66383bcc-a0da-49b3-af67-4473370c5beb req-52d54e47-7bb2-44c2-b338-0cd178aaa7b1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state building and task_state spawning.
Oct 20 18:33:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:33:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance spawned successfully.
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:33:26 user nova-compute[74233]: INFO nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-0433dfef-815b-4872-bc98-40d550ab897c req-0f02a4b5-c479-44c2-aaa5-c0fa204ea6fe service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0433dfef-815b-4872-bc98-40d550ab897c req-0f02a4b5-c479-44c2-aaa5-c0fa204ea6fe service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0433dfef-815b-4872-bc98-40d550ab897c req-0f02a4b5-c479-44c2-aaa5-c0fa204ea6fe service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0433dfef-815b-4872-bc98-40d550ab897c req-0f02a4b5-c479-44c2-aaa5-c0fa204ea6fe service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-0433dfef-815b-4872-bc98-40d550ab897c req-0f02a4b5-c479-44c2-aaa5-c0fa204ea6fe service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:33:26 user nova-compute[74233]: WARNING nova.compute.manager [req-0433dfef-815b-4872-bc98-40d550ab897c req-0f02a4b5-c479-44c2-aaa5-c0fa204ea6fe service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state building and task_state spawning.
Oct 20 18:33:26 user nova-compute[74233]: INFO nova.compute.manager [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Took 7.08 seconds to build instance.
Oct 20 18:33:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-875414af-4159-4c7d-9f53-8419c27221da tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.200s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Starting finish_migration {{(pid=74233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance directory exists: not creating {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 18:33:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Creating image(s)
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Ensure instance console log exists: /opt/stack/data/nova/instances/312f41b0-e549-4b33-be6f-350ec8f8f708/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Start _get_guest_xml network_info=[{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '4e7a8347-bfd0-42a5-8e7f-ba750fa433b9', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '312f41b0-e549-4b33-be6f-350ec8f8f708', 'attached_at': '2023-10-20T18:33:34.000000', 'detached_at': '', 'volume_id': 'bb296a67-61a6-4156-86a3-a61d30c130b3', 'serial': 'bb296a67-61a6-4156-86a3-a61d30c130b3'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:33:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:33:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:33:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:33:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:33:34 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acac49c-2992-40c3-8a96-8bf4ca573859]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:33:34 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d0711-697f-48c0-9fe0-8ecf90c3927c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3] added
Oct 20 18:33:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52e1dc4-5631-4edb-8d1f-e2342536f1ce]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3aa1a5-a9da-4df2-a6d3-36bcb70d217c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlXgJQZh {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlXgJQZh" returned: 0 in 0.028s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3160ba2-f5bb-48b4-a108-c9f2a8f02062]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlXgJQZh'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd4951-a777-4fc4-b832-5701ef3efcf2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d6fb4b-a6d3-49bc-aecf-be910af3ed20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:33:34 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:33:34 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:33:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:33:34 user nova-compute[74233]: 
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20910ae-6a87-432f-a1a4-a93b63ca7c35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]
Oct 20 18:33:34 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.
Oct 20 18:33:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa88dce-a964-4f64-815b-7fee6f7c3194]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde4a9a-b07c-40da-9804-16b25135274d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:33:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:33:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2252c614-9173-4600-b193-2b5c6538b29f]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:33:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23462656530343465', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462656530343465', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-525089166',display_name='tempest-ServerActionsTestOtherA-server-525089166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-525089166',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-9gjpigga',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=312f41b0-e549-4b33-be6f-350ec8f8f708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:33:35 user nova-compute[74233]:   <uuid>312f41b0-e549-4b33-be6f-350ec8f8f708</uuid>
Oct 20 18:33:35 user nova-compute[74233]:   <name>instance-00000028</name>
Oct 20 18:33:35 user nova-compute[74233]:   <memory>2097152</memory>
Oct 20 18:33:35 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:33:35 user nova-compute[74233]:   <metadata>
Oct 20 18:33:35 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:33:35 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:33:35 user nova-compute[74233]:       <nova:name>tempest-ServerActionsTestOtherA-server-525089166</nova:name>
Oct 20 18:33:35 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:33:34</nova:creationTime>
Oct 20 18:33:35 user nova-compute[74233]:       <nova:flavor name="m1.small">
Oct 20 18:33:35 user nova-compute[74233]:         <nova:memory>2048</nova:memory>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:disk>20</nova:disk>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:33:35 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:33:35 user nova-compute[74233]:       <nova:owner>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:user uuid="d132de50b442419e8f3a059e650902e7">tempest-ServerActionsTestOtherA-835796467-project-member</nova:user>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:project uuid="0083be86b8f04d16a891eadad4dccbe6">tempest-ServerActionsTestOtherA-835796467</nova:project>
Oct 20 18:33:35 user nova-compute[74233]:       </nova:owner>
Oct 20 18:33:35 user nova-compute[74233]:       <nova:ports>
Oct 20 18:33:35 user nova-compute[74233]:         <nova:port uuid="43351121-9b87-4f80-be17-6f02244b4ae4">
Oct 20 18:33:35 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 18:33:35 user nova-compute[74233]:         </nova:port>
Oct 20 18:33:35 user nova-compute[74233]:       </nova:ports>
Oct 20 18:33:35 user nova-compute[74233]:     </nova:instance>
Oct 20 18:33:35 user nova-compute[74233]:   </metadata>
Oct 20 18:33:35 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:33:35 user nova-compute[74233]:     <system>
Oct 20 18:33:35 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:33:35 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:33:35 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:33:35 user nova-compute[74233]:       <entry name="serial">312f41b0-e549-4b33-be6f-350ec8f8f708</entry>
Oct 20 18:33:35 user nova-compute[74233]:       <entry name="uuid">312f41b0-e549-4b33-be6f-350ec8f8f708</entry>
Oct 20 18:33:35 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:33:35 user nova-compute[74233]:     </system>
Oct 20 18:33:35 user nova-compute[74233]:   </sysinfo>
Oct 20 18:33:35 user nova-compute[74233]:   <os>
Oct 20 18:33:35 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:33:35 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:33:35 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:33:35 user nova-compute[74233]:   </os>
Oct 20 18:33:35 user nova-compute[74233]:   <features>
Oct 20 18:33:35 user nova-compute[74233]:     <acpi/>
Oct 20 18:33:35 user nova-compute[74233]:     <apic/>
Oct 20 18:33:35 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:33:35 user nova-compute[74233]:   </features>
Oct 20 18:33:35 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:33:35 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:33:35 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:33:35 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:33:35 user nova-compute[74233]:   </clock>
Oct 20 18:33:35 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:33:35 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:33:35 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:33:35 user nova-compute[74233]:   </cpu>
Oct 20 18:33:35 user nova-compute[74233]:   <devices>
Oct 20 18:33:35 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:33:35 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:33:35 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:33:35 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:33:35 user nova-compute[74233]:       <serial>bb296a67-61a6-4156-86a3-a61d30c130b3</serial>
Oct 20 18:33:35 user nova-compute[74233]:     </disk>
Oct 20 18:33:35 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:33:35 user nova-compute[74233]:       <mac address="fa:16:3e:9e:42:69"/>
Oct 20 18:33:35 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:33:35 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:33:35 user nova-compute[74233]:       <target dev="tap43351121-9b"/>
Oct 20 18:33:35 user nova-compute[74233]:     </interface>
Oct 20 18:33:35 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:33:35 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/312f41b0-e549-4b33-be6f-350ec8f8f708/console.log" append="off"/>
Oct 20 18:33:35 user nova-compute[74233]:     </serial>
Oct 20 18:33:35 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:33:35 user nova-compute[74233]:     <video>
Oct 20 18:33:35 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:33:35 user nova-compute[74233]:     </video>
Oct 20 18:33:35 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:33:35 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:33:35 user nova-compute[74233]:     </rng>
Oct 20 18:33:35 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:33:35 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:33:35 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:33:35 user nova-compute[74233]:     </memballoon>
Oct 20 18:33:35 user nova-compute[74233]:   </devices>
Oct 20 18:33:35 user nova-compute[74233]: </domain>
Oct 20 18:33:35 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-525089166',display_name='tempest-ServerActionsTestOtherA-server-525089166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-525089166',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-9gjpigga',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=312f41b0-e549-4b33-be6f-350ec8f8f708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-367867003-network", "vif_mac": "fa:16:3e:9e:42:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG os_vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17cb4d6c-d50a-5ae2-a92f-86c4851c786b', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43351121-9b, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43351121-9b, col_values=(('qos', UUID('037202ad-02f9-4975-b3ba-265f6629de70')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43351121-9b, col_values=(('external_ids', {'iface-id': '43351121-9b87-4f80-be17-6f02244b4ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:42:69', 'vm-uuid': '312f41b0-e549-4b33-be6f-350ec8f8f708'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:35 user nova-compute[74233]: INFO os_vif [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b')
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:33:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] No VIF found with MAC fa:16:3e:9e:42:69, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-da6efb6c-1cdf-44e8-8267-716c4003e432 req-c8d94451-28d1-42d9-8f92-eb9a2c856c4e service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-da6efb6c-1cdf-44e8-8267-716c4003e432 req-c8d94451-28d1-42d9-8f92-eb9a2c856c4e service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-da6efb6c-1cdf-44e8-8267-716c4003e432 req-c8d94451-28d1-42d9-8f92-eb9a2c856c4e service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-da6efb6c-1cdf-44e8-8267-716c4003e432 req-c8d94451-28d1-42d9-8f92-eb9a2c856c4e service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-da6efb6c-1cdf-44e8-8267-716c4003e432 req-c8d94451-28d1-42d9-8f92-eb9a2c856c4e service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:33:37 user nova-compute[74233]: WARNING nova.compute.manager [req-da6efb6c-1cdf-44e8-8267-716c4003e432 req-c8d94451-28d1-42d9-8f92-eb9a2c856c4e service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state resize_finish.
Oct 20 18:33:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-a48f70c9-eb49-4dc2-b3c5-1f402f70e62a req-6b88e290-ca8b-405d-b337-7642f3f808e4 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:33:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a48f70c9-eb49-4dc2-b3c5-1f402f70e62a req-6b88e290-ca8b-405d-b337-7642f3f808e4 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a48f70c9-eb49-4dc2-b3c5-1f402f70e62a req-6b88e290-ca8b-405d-b337-7642f3f808e4 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a48f70c9-eb49-4dc2-b3c5-1f402f70e62a req-6b88e290-ca8b-405d-b337-7642f3f808e4 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-a48f70c9-eb49-4dc2-b3c5-1f402f70e62a req-6b88e290-ca8b-405d-b337-7642f3f808e4 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:33:39 user nova-compute[74233]: WARNING nova.compute.manager [req-a48f70c9-eb49-4dc2-b3c5-1f402f70e62a req-6b88e290-ca8b-405d-b337-7642f3f808e4 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state resize_finish.
Oct 20 18:33:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:33:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance running successfully.
Oct 20 18:33:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Failed to set time: agent not configured {{(pid=74233) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 18:33:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d506840f-133d-42be-af1d-37b0609c1a32 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] finish_migration finished successfully. {{(pid=74233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 18:33:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:33:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:33:59 user nova-compute[74233]: INFO nova.compute.claims [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Claim successful on node user
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.network.neutron [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:33:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.policy [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3609d0bdf81640bebfbca48da9d36bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66219789fe614a1ba90fd90e94ead88c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:33:59 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Creating image(s)
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "/opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "/opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "/opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:33:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk 1073741824" returned: 0 in 0.072s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Successfully created port: 8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Cannot resize image /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Ensure instance console log exists: /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Successfully updated port: 8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquired lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-changed-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Refreshing instance network info cache due to event network-changed-8f1b8a14-eeee-40e1-873e-d28119331c31. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] Acquiring lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:34:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.neutron [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updating instance_info_cache with network_info: [{"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Releasing lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Instance network_info: |[{"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] Acquired lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Refreshing network info cache for port 8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Start _get_guest_xml network_info=[{"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:34:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:34:01 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6972128',id=42,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXkt0uhzU7yluJtGuFESCgaWA0XcTtfYT4QqUrTZqVzvPu6NxoA3ZRQCDXHAj5pRFVTJJMTi+gXXbzKO6g27Udzz2wRVsGpu4TPcQs5yOaq2wgUMC5OM8HVv29cBFoCbw==',key_name='tempest-keypair-1343452472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66219789fe614a1ba90fd90e94ead88c',ramdisk_id='',reservation_id='r-kdgxffgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105138341',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3609d0bdf81640bebfbca48da9d36bdc',uuid=34cf442b-e6d3-4ccf-a204-22e5e4230ca8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Converting VIF {"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.objects.instance [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lazy-loading 'pci_devices' on Instance uuid 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:34:01 user nova-compute[74233]:   <uuid>34cf442b-e6d3-4ccf-a204-22e5e4230ca8</uuid>
Oct 20 18:34:01 user nova-compute[74233]:   <name>instance-0000002a</name>
Oct 20 18:34:01 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:34:01 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:34:01 user nova-compute[74233]:   <metadata>
Oct 20 18:34:01 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:34:01 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:34:01 user nova-compute[74233]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831</nova:name>
Oct 20 18:34:01 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:34:01</nova:creationTime>
Oct 20 18:34:01 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:34:01 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:34:01 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:34:01 user nova-compute[74233]:       <nova:owner>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:user uuid="3609d0bdf81640bebfbca48da9d36bdc">tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member</nova:user>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:project uuid="66219789fe614a1ba90fd90e94ead88c">tempest-TestServerVolumeAttachScenarioOldVersion-1105138341</nova:project>
Oct 20 18:34:01 user nova-compute[74233]:       </nova:owner>
Oct 20 18:34:01 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:34:01 user nova-compute[74233]:       <nova:ports>
Oct 20 18:34:01 user nova-compute[74233]:         <nova:port uuid="8f1b8a14-eeee-40e1-873e-d28119331c31">
Oct 20 18:34:01 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:34:01 user nova-compute[74233]:         </nova:port>
Oct 20 18:34:01 user nova-compute[74233]:       </nova:ports>
Oct 20 18:34:01 user nova-compute[74233]:     </nova:instance>
Oct 20 18:34:01 user nova-compute[74233]:   </metadata>
Oct 20 18:34:01 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:34:01 user nova-compute[74233]:     <system>
Oct 20 18:34:01 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:34:01 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:34:01 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:34:01 user nova-compute[74233]:       <entry name="serial">34cf442b-e6d3-4ccf-a204-22e5e4230ca8</entry>
Oct 20 18:34:01 user nova-compute[74233]:       <entry name="uuid">34cf442b-e6d3-4ccf-a204-22e5e4230ca8</entry>
Oct 20 18:34:01 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:34:01 user nova-compute[74233]:     </system>
Oct 20 18:34:01 user nova-compute[74233]:   </sysinfo>
Oct 20 18:34:01 user nova-compute[74233]:   <os>
Oct 20 18:34:01 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:34:01 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:34:01 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:34:01 user nova-compute[74233]:   </os>
Oct 20 18:34:01 user nova-compute[74233]:   <features>
Oct 20 18:34:01 user nova-compute[74233]:     <acpi/>
Oct 20 18:34:01 user nova-compute[74233]:     <apic/>
Oct 20 18:34:01 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:34:01 user nova-compute[74233]:   </features>
Oct 20 18:34:01 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:34:01 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:34:01 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:34:01 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:34:01 user nova-compute[74233]:   </clock>
Oct 20 18:34:01 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:34:01 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:34:01 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:34:01 user nova-compute[74233]:   </cpu>
Oct 20 18:34:01 user nova-compute[74233]:   <devices>
Oct 20 18:34:01 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:34:01 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:34:01 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk"/>
Oct 20 18:34:01 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:34:01 user nova-compute[74233]:     </disk>
Oct 20 18:34:01 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:34:01 user nova-compute[74233]:       <mac address="fa:16:3e:c3:86:62"/>
Oct 20 18:34:01 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:34:01 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:34:01 user nova-compute[74233]:       <target dev="tap8f1b8a14-ee"/>
Oct 20 18:34:01 user nova-compute[74233]:     </interface>
Oct 20 18:34:01 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:34:01 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/console.log" append="off"/>
Oct 20 18:34:01 user nova-compute[74233]:     </serial>
Oct 20 18:34:01 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:34:01 user nova-compute[74233]:     <video>
Oct 20 18:34:01 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:34:01 user nova-compute[74233]:     </video>
Oct 20 18:34:01 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:34:01 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:34:01 user nova-compute[74233]:     </rng>
Oct 20 18:34:01 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:34:01 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:34:01 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:34:01 user nova-compute[74233]:     </memballoon>
Oct 20 18:34:01 user nova-compute[74233]:   </devices>
Oct 20 18:34:01 user nova-compute[74233]: </domain>
Oct 20 18:34:01 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6972128',id=42,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXkt0uhzU7yluJtGuFESCgaWA0XcTtfYT4QqUrTZqVzvPu6NxoA3ZRQCDXHAj5pRFVTJJMTi+gXXbzKO6g27Udzz2wRVsGpu4TPcQs5yOaq2wgUMC5OM8HVv29cBFoCbw==',key_name='tempest-keypair-1343452472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66219789fe614a1ba90fd90e94ead88c',ramdisk_id='',reservation_id='r-kdgxffgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105138341',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3609d0bdf81640bebfbca48da9d36bdc',uuid=34cf442b-e6d3-4ccf-a204-22e5e4230ca8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Converting VIF {"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG os_vif [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd67635bb-475a-5ffd-8ead-219d0844ba77', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1b8a14-ee, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f1b8a14-ee, col_values=(('qos', UUID('48b75024-dead-403b-8a3c-8a805e3cfbe1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f1b8a14-ee, col_values=(('external_ids', {'iface-id': '8f1b8a14-eeee-40e1-873e-d28119331c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:86:62', 'vm-uuid': '34cf442b-e6d3-4ccf-a204-22e5e4230ca8'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:01 user nova-compute[74233]: INFO os_vif [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee')
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] No VIF found with MAC fa:16:3e:c3:86:62, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updated VIF entry in instance network info cache for port 8f1b8a14-eeee-40e1-873e-d28119331c31. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG nova.network.neutron [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updating instance_info_cache with network_info: [{"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:34:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-936178ca-b075-450d-9b32-87324b50e585 req-77b78d1b-d085-4fdc-9bf9-6fe80e27a72d service nova] Releasing lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:34:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-ef4d5af3-d421-4e98-bc7c-08ec5994fa64 req-954f5f17-9c33-4f10-813b-607f0f92968f service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ef4d5af3-d421-4e98-bc7c-08ec5994fa64 req-954f5f17-9c33-4f10-813b-607f0f92968f service nova] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ef4d5af3-d421-4e98-bc7c-08ec5994fa64 req-954f5f17-9c33-4f10-813b-607f0f92968f service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ef4d5af3-d421-4e98-bc7c-08ec5994fa64 req-954f5f17-9c33-4f10-813b-607f0f92968f service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-ef4d5af3-d421-4e98-bc7c-08ec5994fa64 req-954f5f17-9c33-4f10-813b-607f0f92968f service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] No waiting events found dispatching network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:34:03 user nova-compute[74233]: WARNING nova.compute.manager [req-ef4d5af3-d421-4e98-bc7c-08ec5994fa64 req-954f5f17-9c33-4f10-813b-607f0f92968f service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received unexpected event network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 for instance with vm_state building and task_state spawning.
Oct 20 18:34:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:34:04 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Instance spawned successfully.
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:34:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:34:05 user nova-compute[74233]: INFO nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 18:34:05 user nova-compute[74233]: DEBUG nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:34:05 user nova-compute[74233]: INFO nova.compute.manager [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Took 6.09 seconds to build instance.
Oct 20 18:34:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-062486b9-1f8d-4d47-bde7-1dda154847a9 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.197s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-e76fda15-bd57-4a55-b14e-ab7d8f35e954 req-b77d0ac7-8e1d-4bcd-9316-272c9435effe service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:34:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e76fda15-bd57-4a55-b14e-ab7d8f35e954 req-b77d0ac7-8e1d-4bcd-9316-272c9435effe service nova] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:34:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e76fda15-bd57-4a55-b14e-ab7d8f35e954 req-b77d0ac7-8e1d-4bcd-9316-272c9435effe service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:34:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e76fda15-bd57-4a55-b14e-ab7d8f35e954 req-b77d0ac7-8e1d-4bcd-9316-272c9435effe service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:05 user nova-compute[74233]: DEBUG nova.compute.manager [req-e76fda15-bd57-4a55-b14e-ab7d8f35e954 req-b77d0ac7-8e1d-4bcd-9316-272c9435effe service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] No waiting events found dispatching network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:34:05 user nova-compute[74233]: WARNING nova.compute.manager [req-e76fda15-bd57-4a55-b14e-ab7d8f35e954 req-b77d0ac7-8e1d-4bcd-9316-272c9435effe service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received unexpected event network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 for instance with vm_state active and task_state None.
Oct 20 18:34:05 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:34:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:11 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:34:11 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.18067169189453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Applying migration context for instance 312f41b0-e549-4b33-be6f-350ec8f8f708 as it has an incoming, in-progress migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed. Migration status is finished {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 18:34:11 user nova-compute[74233]: INFO nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating resource usage from migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 312f41b0-e549-4b33-be6f-350ec8f8f708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f0309a68-e7f9-4a0a-84ac-5bb0794315be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:34:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:34:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:34:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:34:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:34:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:34:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:34:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:34:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:34:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:34:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:34:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:34:18 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 9d8f3218-2a57-452f-8251-2d5591c9f09a {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:34:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:34:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:34:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:34:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:34:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:34:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:34:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:34:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:34:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:34:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:34:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:34:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:34:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:34:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Going to confirm migration 2 {{(pid=74233) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'info_cache' on Instance uuid 312f41b0-e549-4b33-be6f-350ec8f8f708 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'migration_context' on Instance uuid 312f41b0-e549-4b33-be6f-350ec8f8f708 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG nova.objects.base [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Object Instance<312f41b0-e549-4b33-be6f-350ec8f8f708> lazy-loaded attributes: info_cache,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.253s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:01 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Deleted allocation for migration fd55ab38-cf8d-4c2c-b009-0ed946f2f7ed
Oct 20 18:35:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e2fd6e7-ec16-4689-91cc-6f255486e68e tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.681s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:35:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:35:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:35:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:35:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:35:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.compute.manager [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing instance network info cache due to event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updated VIF entry in instance network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.network.neutron [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-744c3a45-4171-4e21-bf9b-ffeea4a30aa6 req-3f655190-2b50-4baa-863a-f09498159fb1 service nova] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:35:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:35:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=25.151351928710938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 312f41b0-e549-4b33-be6f-350ec8f8f708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f0309a68-e7f9-4a0a-84ac-5bb0794315be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:35:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:19 user nova-compute[74233]: INFO nova.compute.manager [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Shelving
Oct 20 18:35:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-d4ab15e6-7b9a-4775-a46b-ac1d8b2853ef req-ac096a60-ee6a-43d3-ba31-358ca4b8aaa7 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-unplugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d4ab15e6-7b9a-4775-a46b-ac1d8b2853ef req-ac096a60-ee6a-43d3-ba31-358ca4b8aaa7 service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d4ab15e6-7b9a-4775-a46b-ac1d8b2853ef req-ac096a60-ee6a-43d3-ba31-358ca4b8aaa7 service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d4ab15e6-7b9a-4775-a46b-ac1d8b2853ef req-ac096a60-ee6a-43d3-ba31-358ca4b8aaa7 service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-d4ab15e6-7b9a-4775-a46b-ac1d8b2853ef req-ac096a60-ee6a-43d3-ba31-358ca4b8aaa7 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-unplugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:35:19 user nova-compute[74233]: WARNING nova.compute.manager [req-d4ab15e6-7b9a-4775-a46b-ac1d8b2853ef req-ac096a60-ee6a-43d3-ba31-358ca4b8aaa7 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-unplugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state active and task_state shelving.
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:35:19 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:35:19 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance destroyed successfully.
Oct 20 18:35:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Beginning cold snapshot process
Oct 20 18:35:20 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:35:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk /opt/stack/data/nova/instances/snapshots/tmppiqmn2rx/5f4f3d8f1e9445cdaee78715d0f28f46 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:20 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [{"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:35:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-312f41b0-e549-4b33-be6f-350ec8f8f708" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:35:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:35:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:35:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk /opt/stack/data/nova/instances/snapshots/tmppiqmn2rx/5f4f3d8f1e9445cdaee78715d0f28f46" returned: 0 in 0.566s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Snapshot extracted, beginning image upload
Oct 20 18:35:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-4c3c0e45-918c-4fb6-8021-17e7d43ff613 req-3e461405-37fc-427c-8f1e-d7dea34b7d9e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:35:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4c3c0e45-918c-4fb6-8021-17e7d43ff613 req-3e461405-37fc-427c-8f1e-d7dea34b7d9e service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4c3c0e45-918c-4fb6-8021-17e7d43ff613 req-3e461405-37fc-427c-8f1e-d7dea34b7d9e service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4c3c0e45-918c-4fb6-8021-17e7d43ff613 req-3e461405-37fc-427c-8f1e-d7dea34b7d9e service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:21 user nova-compute[74233]: DEBUG nova.compute.manager [req-4c3c0e45-918c-4fb6-8021-17e7d43ff613 req-3e461405-37fc-427c-8f1e-d7dea34b7d9e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:35:21 user nova-compute[74233]: WARNING nova.compute.manager [req-4c3c0e45-918c-4fb6-8021-17e7d43ff613 req-3e461405-37fc-427c-8f1e-d7dea34b7d9e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 18:35:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Snapshot image upload complete
Oct 20 18:35:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:35:23 user nova-compute[74233]: INFO nova.compute.manager [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Shelve offloading
Oct 20 18:35:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance destroyed successfully.
Oct 20 18:35:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:35:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:35:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:35:23 user nova-compute[74233]: DEBUG nova.network.neutron [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:35:23 user nova-compute[74233]: DEBUG nova.network.neutron [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:35:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:35:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance destroyed successfully.
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.objects.instance [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'resources' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1393302681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1393302681',id=41,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4rklmJ1LGAqZWHX4SPY8EYpE9I39QL0J+AH8+zEwRZ/0B/bkgavKFtoka6akRq5raqRWRLP9Z8iaIGuwcJV9GHLODx0yR7Cq58Q3Li1bGzisL3e3an3Wr5/ovfXLTuA==',key_name='tempest-keypair-893393640',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-fjkx79sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member',shelved_at='2023-10-20T18:35:23.442043',shelved_host='user',shelved_image_id='7256fea0-e733-456b-b58b-d05c2111dc31'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f0309a68-e7f9-4a0a-84ac-5bb0794315be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG os_vif [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap931fbf57-df, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing instance network info cache due to event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.network.neutron [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06561f36-b783-4724-bc77-163d383a938d) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:35:24 user nova-compute[74233]: INFO os_vif [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df')
Oct 20 18:35:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Deleting instance files /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be_del
Oct 20 18:35:24 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Deletion of /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be_del complete
Oct 20 18:35:24 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Deleted allocations for instance f0309a68-e7f9-4a0a-84ac-5bb0794315be
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.objects.instance [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'numa_topology' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.objects.base [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f0309a68-e7f9-4a0a-84ac-5bb0794315be> lazy-loaded attributes: resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.network.neutron [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updated VIF entry in instance network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG nova.network.neutron [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap931fbf57-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-dc8c9062-cf74-4b58-9773-b7a4392eb2ac req-fba20ca7-e214-47ba-9271-553d21b84ccd service nova] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:35:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-939317d6-6a4a-459b-9e8e-33cc590b9e5d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.773s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-changed-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:35:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Refreshing instance network info cache due to event network-changed-8f1b8a14-eeee-40e1-873e-d28119331c31. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:35:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] Acquiring lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:35:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] Acquired lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:35:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Refreshing network info cache for port 8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:35:50 user nova-compute[74233]: DEBUG nova.network.neutron [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updated VIF entry in instance network info cache for port 8f1b8a14-eeee-40e1-873e-d28119331c31. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:35:50 user nova-compute[74233]: DEBUG nova.network.neutron [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updating instance_info_cache with network_info: [{"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:35:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-42c81b8b-0a5e-4165-bb1f-90a75c1c2178 req-17d1628a-8d4f-44cb-b645-95d477469072 service nova] Releasing lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:35:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lazy-loading 'flavor' on Instance uuid 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:35:55 user nova-compute[74233]: INFO nova.compute.manager [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Attaching volume 35dba2af-dae4-4fcf-9a97-05aa94755dbc to /dev/vdb
Oct 20 18:35:55 user nova-compute[74233]: DEBUG os_brick.utils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e83ffe1-d260-4ce7-a270-7fabe1d21864]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f308475-b413-4212-951b-ce7aa4000224]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef43368-65a9-4de5-bc9a-8ef5686407cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b246bd30-5307-4d10-a326-cb02357d4e8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:35:55 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:35:55 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39d6be-bbeb-453b-9407-00528e41e233]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG os_brick.utils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:35:55 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updating existing volume attachment record: bfd1c7d2-ccf2-44d3-af27-e6ab6a019ed3 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:35:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:35:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:10 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:36:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:36:10 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:36:10 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:36:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:36:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.121288299560547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 312f41b0-e549-4b33-be6f-350ec8f8f708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCSsWEeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:36:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:36:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:36:12 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a739e3-13a6-466a-8c66-fdddd0d4a168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:36:12 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f38bd3-2e3d-461a-a409-612a6e6b9b05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc] added
Oct 20 18:36:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52225785-5299-486a-baaa-3c0cb5f651ea]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca6058-b7f1-41b3-8eae-da02bd3bea3f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCSsWEeq {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCSsWEeq" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f545f3d8-18ab-4791-8124-14355b70633d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wCSsWEeq'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b312c92e-5370-409f-abe5-a98e57ae168f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e05ab55-8c12-43d2-bed3-4ab1be82e94b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:36:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:36:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd847880-be8c-48c5-8e27-b1516f2642a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260]
Oct 20 18:36:12 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260] successful.
Oct 20 18:36:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[969ff4ac-27a0-4932-a539-66a7f648dd27]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1813d-6d46-415e-b9d6-62bd160a72fa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:36:12 user nova-compute[74233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc (non-flash)
Oct 20 18:36:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:36:12 user nova-compute[74233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc (non-flash)
Oct 20 18:36:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[472a33cb-ff32-4db9-a156-b76434914009]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:36:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCSsWEeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23430373537643039', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430373537643039', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.objects.instance [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lazy-loading 'flavor' on Instance uuid 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:36:13 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:36:13 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:36:13 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:36:13 user nova-compute[74233]:   <serial>35dba2af-dae4-4fcf-9a97-05aa94755dbc</serial>
Oct 20 18:36:13 user nova-compute[74233]: </disk>
Oct 20 18:36:13 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:36:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] No VIF found with MAC fa:16:3e:c3:86:62, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:36:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-94516079-120e-4312-9591-bbd4c2c10e14 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.341s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:36:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:36:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:36:15 user nova-compute[74233]: INFO nova.compute.manager [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Detaching volume 35dba2af-dae4-4fcf-9a97-05aa94755dbc
Oct 20 18:36:16 user nova-compute[74233]: INFO nova.virt.block_device [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Attempting to driver detach volume 35dba2af-dae4-4fcf-9a97-05aa94755dbc from mountpoint /dev/vdb
Oct 20 18:36:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Attempting to detach device vdb from instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:36:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:36:16 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:36:16 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:36:16 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:36:16 user nova-compute[74233]:   <serial>35dba2af-dae4-4fcf-9a97-05aa94755dbc</serial>
Oct 20 18:36:16 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:36:16 user nova-compute[74233]: </disk>
Oct 20 18:36:16 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:36:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Successfully detached device vdb from instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 from the persistent domain config.
Oct 20 18:36:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:36:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:36:16 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:36:16 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:36:16 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:36:16 user nova-compute[74233]:   <serial>35dba2af-dae4-4fcf-9a97-05aa94755dbc</serial>
Oct 20 18:36:16 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:36:16 user nova-compute[74233]: </disk>
Oct 20 18:36:16 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:36:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:36:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:36:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:36:21 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:36:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updating instance_info_cache with network_info: [{"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:36:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-34cf442b-e6d3-4ccf-a204-22e5e4230ca8" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:36:22 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:36:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:36:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 is timed out.
Oct 20 18:36:36 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Successfully detached device vdb from instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 from the live domain config.
Oct 20 18:36:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCSsWEeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:36:36 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49fb9c-ba27-4fe8-9c64-792e37690186]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:36:36 user nova-compute[74233]: No targets found.
Oct 20 18:36:36 user nova-compute[74233]: iSNS:
Oct 20 18:36:36 user nova-compute[74233]: No targets found.
Oct 20 18:36:36 user nova-compute[74233]: STATIC:
Oct 20 18:36:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc
Oct 20 18:36:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:36:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:36:36 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3
Oct 20 18:36:36 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:36:36 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:36:36 user nova-compute[74233]: FIRMWARE:
Oct 20 18:36:36 user nova-compute[74233]: No targets found.
Oct 20 18:36:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:36:36 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:36:36 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbecf4c-a207-4f8b-9f88-fc51602d003f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f63fb-0d5d-44ec-ac17-b6dbbb32d9cb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:36:36 user nova-compute[74233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc (non-flash)
Oct 20 18:36:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:36:36 user nova-compute[74233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc (non-flash)
Oct 20 18:36:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970648ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b74b7be-a3f5-4650-b4d7-858b6e0d241b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf3f1bc-8dde-4c99-a4c9-6def459a77ab]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9b377-7826-4205-a667-fe38d231fcfb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d0e7d-542a-42d3-b3e5-9f64297a8cd6]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee768e4c-0849-4005-80bf-f6543fc9d0ec]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3752563b-9a3e-4e17-87c2-df8562582368]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260]
Oct 20 18:36:36 user nova-compute[74233]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc, portal: 172.16.0.220,3260] successful.
Oct 20 18:36:36 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35dba2af-dae4-4fcf-9a97-05aa94755dbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73789f0-3231-4077-8da2-8a1787eb264b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] <== disconnect_volume: return (274ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:36:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:36:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lazy-loading 'flavor' on Instance uuid 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:36:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c002505c-6891-4254-9bdb-ede2746e893e tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:36:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:50 user nova-compute[74233]: INFO nova.compute.manager [None req-299c08c7-fc3a-4475-8999-f25ddb5f5d1c tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Get console output
Oct 20 18:36:50 user nova-compute[74233]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 18:36:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:36:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:11 user nova-compute[74233]: INFO nova.compute.manager [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Unshelving
Oct 20 18:37:11 user nova-compute[74233]: INFO nova.virt.block_device [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Booting with volume f0485bd1-59f4-450d-af14-68758067dcac at /dev/vdc
Oct 20 18:37:11 user nova-compute[74233]: DEBUG os_brick.utils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb8d35-da58-424d-94f3-200849f9dd10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a486baf7-f3fb-4931-8e58-2d37933943f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5628c343-038d-421c-a1d0-a4ae66b8fc64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1bbebd-b4bb-40dd-a476-2220718b1701]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:37:11 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d86c3-b48e-47fe-ada2-f0da581947af]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG os_brick.utils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating existing volume attachment record: d704715b-60b3-419a-904c-023274f0a466 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:37:11 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:13 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:37:13 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.120166778564453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 312f41b0-e549-4b33-be6f-350ec8f8f708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f0309a68-e7f9-4a0a-84ac-5bb0794315be has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:37:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:37:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:37:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:37:22 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 9d8f3218-2a57-452f-8251-2d5591c9f09a {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:23 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [{"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:37:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-9d8f3218-2a57-452f-8251-2d5591c9f09a" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:37:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:37:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:25 user nova-compute[74233]: INFO nova.compute.manager [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Terminating instance
Oct 20 18:37:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e91a9ba-7588-4785-8cbe-a6a4a4d327d9 req-ddc972f2-ded8-4e47-baca-72ef88cca215 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-vif-unplugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e91a9ba-7588-4785-8cbe-a6a4a4d327d9 req-ddc972f2-ded8-4e47-baca-72ef88cca215 service nova] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e91a9ba-7588-4785-8cbe-a6a4a4d327d9 req-ddc972f2-ded8-4e47-baca-72ef88cca215 service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e91a9ba-7588-4785-8cbe-a6a4a4d327d9 req-ddc972f2-ded8-4e47-baca-72ef88cca215 service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e91a9ba-7588-4785-8cbe-a6a4a4d327d9 req-ddc972f2-ded8-4e47-baca-72ef88cca215 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] No waiting events found dispatching network-vif-unplugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e91a9ba-7588-4785-8cbe-a6a4a4d327d9 req-ddc972f2-ded8-4e47-baca-72ef88cca215 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-vif-unplugged-8f1b8a14-eeee-40e1-873e-d28119331c31 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:37:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Instance destroyed successfully.
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lazy-loading 'resources' on Instance uuid 34cf442b-e6d3-4ccf-a204-22e5e4230ca8 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-697212831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6972128',id=42,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXkt0uhzU7yluJtGuFESCgaWA0XcTtfYT4QqUrTZqVzvPu6NxoA3ZRQCDXHAj5pRFVTJJMTi+gXXbzKO6g27Udzz2wRVsGpu4TPcQs5yOaq2wgUMC5OM8HVv29cBFoCbw==',key_name='tempest-keypair-1343452472',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66219789fe614a1ba90fd90e94ead88c',ramdisk_id='',reservation_id='r-kdgxffgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105138341',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3609d0bdf81640bebfbca48da9d36bdc',uuid=34cf442b-e6d3-4ccf-a204-22e5e4230ca8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Converting VIF {"id": "8f1b8a14-eeee-40e1-873e-d28119331c31", "address": "fa:16:3e:c3:86:62", "network": {"id": "cf2be292-5d71-4846-8459-4a8f0f76d3ea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1410137988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66219789fe614a1ba90fd90e94ead88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1b8a14-ee", "ovs_interfaceid": "8f1b8a14-eeee-40e1-873e-d28119331c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG os_vif [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1b8a14-ee, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48b75024-dead-403b-8a3c-8a805e3cfbe1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:26 user nova-compute[74233]: INFO os_vif [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:86:62,bridge_name='br-int',has_traffic_filtering=True,id=8f1b8a14-eeee-40e1-873e-d28119331c31,network=Network(cf2be292-5d71-4846-8459-4a8f0f76d3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1b8a14-ee')
Oct 20 18:37:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Deleting instance files /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8_del
Oct 20 18:37:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Deletion of /opt/stack/data/nova/instances/34cf442b-e6d3-4ccf-a204-22e5e4230ca8_del complete
Oct 20 18:37:26 user nova-compute[74233]: INFO nova.compute.manager [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 20 18:37:26 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:37:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:27 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:37:27 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Took 0.75 seconds to deallocate network for instance.
Oct 20 18:37:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:27 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:37:27 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:37:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:27 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Deleted allocations for instance 34cf442b-e6d3-4ccf-a204-22e5e4230ca8
Oct 20 18:37:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-db1c14aa-2c27-4839-b37e-bf5034f567aa tempest-TestServerVolumeAttachScenarioOldVersion-1105138341 tempest-TestServerVolumeAttachScenarioOldVersion-1105138341-project-member] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.155s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] Acquiring lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] Lock "34cf442b-e6d3-4ccf-a204-22e5e4230ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] No waiting events found dispatching network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:28 user nova-compute[74233]: WARNING nova.compute.manager [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received unexpected event network-vif-plugged-8f1b8a14-eeee-40e1-873e-d28119331c31 for instance with vm_state deleted and task_state None.
Oct 20 18:37:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-000e9bc7-4547-4c2c-ae91-364653dc7f61 req-4e618d8b-5197-44d4-851b-70184049f0e0 service nova] [instance: 34cf442b-e6d3-4ccf-a204-22e5e4230ca8] Received event network-vif-deleted-8f1b8a14-eeee-40e1-873e-d28119331c31 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:37:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:37:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:37:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'pci_requests' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'numa_topology' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:37:38 user nova-compute[74233]: INFO nova.compute.claims [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Claim successful on node user
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:38 user nova-compute[74233]: INFO nova.network.neutron [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating port 931fbf57-df65-4214-b135-c6a4be7374d3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing instance network info cache due to event network-changed-931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:37:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] Acquiring lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:37:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Creating image(s)
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] Acquired lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Refreshing network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG nova.objects.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f0309a68-e7f9-4a0a-84ac-5bb0794315be> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "5e74349d9947366281ff94d4229905bb62f17fda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "5e74349d9947366281ff94d4229905bb62f17fda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG nova.virt.images [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] 7256fea0-e733-456b-b58b-d05c2111dc31 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.part /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updated VIF entry in instance network info cache for port 931fbf57-df65-4214-b135-c6a4be7374d3. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:37:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e2c8c10f-ce07-4d87-b060-1114a4b2fd7f req-536b3340-f4af-4310-bd89-542fcd19d3ae service nova] Releasing lock "refresh_cache-f0309a68-e7f9-4a0a-84ac-5bb0794315be" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.part /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.converted" returned: 0 in 0.533s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "5e74349d9947366281ff94d4229905bb62f17fda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.119s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "5e74349d9947366281ff94d4229905bb62f17fda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "5e74349d9947366281ff94d4229905bb62f17fda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda,backing_fmt=raw /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda,backing_fmt=raw /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk 1073741824" returned: 0 in 0.047s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "5e74349d9947366281ff94d4229905bb62f17fda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'migration_context' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:41 user nova-compute[74233]: DEBUG nova.objects.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f0309a68-e7f9-4a0a-84ac-5bb0794315be> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:37:41 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Rebasing disk image.
Oct 20 18:37:41 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 -F raw /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 -F raw /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk" returned: 0 in 2.111s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Ensure instance console log exists: /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Start _get_guest_xml network_info=[{"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e1acf2fe36e8ad676c12cbf53b6cd6de',container_format='bare',created_at=2023-10-20T18:35:19Z,direct_url=<?>,disk_format='qcow2',id=7256fea0-e733-456b-b58b-d05c2111dc31,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1393302681-shelved',owner='92e472b626ad43d8b1422b554b64b1a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T18:35:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'd704715b-60b3-419a-904c-023274f0a466', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syiHnFDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f0309a68-e7f9-4a0a-84ac-5bb0794315be', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0485bd1-59f4-450d-af14-68758067dcac', 'serial': 'f0485bd1-59f4-450d-af14-68758067dcac'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:37:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:37:44 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e1acf2fe36e8ad676c12cbf53b6cd6de',container_format='bare',created_at=2023-10-20T18:35:19Z,direct_url=<?>,disk_format='qcow2',id=7256fea0-e733-456b-b58b-d05c2111dc31,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1393302681-shelved',owner='92e472b626ad43d8b1422b554b64b1a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T18:35:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.objects.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f0309a68-e7f9-4a0a-84ac-5bb0794315be> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syiHnFDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:37:44 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:37:44 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:37:44 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f93342a-61a9-4b81-be3c-f4d22c3bd91c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:37:44 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bc29f-ffa6-4ed2-af9d-6721135e98c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac] added
Oct 20 18:37:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a9631c-76ca-42a4-b353-c84f4a0f0b49]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0d9a64-2b6d-4201-8495-3ffb7b7338d5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syiHnFDq {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syiHnFDq" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f85a9-ff3f-4129-8957-eb50e405935e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syiHnFDq'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e5712d-a04f-4389-bfaa-25b2d65d448e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd7f70-decc-483c-a229-f8250fe610f3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:37:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:37:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853f518-5159-49b1-9b8d-ec6a570ba660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260]
Oct 20 18:37:44 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260] successful.
Oct 20 18:37:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d054a64-6cef-4848-bbc8-271d27b293cc]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e1c44-a057-4ef5-b05a-ac7bee4a3c54]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:37:44 user nova-compute[74233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:37:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:37:44 user nova-compute[74233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:37:44 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f336875-bc84-4948-8032-573ee999d9dc]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:44 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syiHnFDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26361666666303366', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361666666303366', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1393302681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1393302681',id=41,image_ref='7256fea0-e733-456b-b58b-d05c2111dc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-893393640',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-fjkx79sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member',shelved_at='2023-10-20T18:35:23.442043',shelved_host='user',shelved_image_id='7256fea0-e733-456b-b58b-d05c2111dc31'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f0309a68-e7f9-4a0a-84ac-5bb0794315be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.objects.instance [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'pci_devices' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.objects.base [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f0309a68-e7f9-4a0a-84ac-5bb0794315be> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:37:45 user nova-compute[74233]:   <uuid>f0309a68-e7f9-4a0a-84ac-5bb0794315be</uuid>
Oct 20 18:37:45 user nova-compute[74233]:   <name>instance-00000029</name>
Oct 20 18:37:45 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:37:45 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:37:45 user nova-compute[74233]:   <metadata>
Oct 20 18:37:45 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:37:45 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:37:45 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1393302681</nova:name>
Oct 20 18:37:45 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:37:44</nova:creationTime>
Oct 20 18:37:45 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:37:45 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:37:45 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:37:45 user nova-compute[74233]:       <nova:owner>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:user uuid="efd2c1848a2c437082490de2207c58b7">tempest-AttachVolumeShelveTestJSON-97665862-project-member</nova:user>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:project uuid="92e472b626ad43d8b1422b554b64b1a9">tempest-AttachVolumeShelveTestJSON-97665862</nova:project>
Oct 20 18:37:45 user nova-compute[74233]:       </nova:owner>
Oct 20 18:37:45 user nova-compute[74233]:       <nova:root type="image" uuid="7256fea0-e733-456b-b58b-d05c2111dc31"/>
Oct 20 18:37:45 user nova-compute[74233]:       <nova:ports>
Oct 20 18:37:45 user nova-compute[74233]:         <nova:port uuid="931fbf57-df65-4214-b135-c6a4be7374d3">
Oct 20 18:37:45 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:37:45 user nova-compute[74233]:         </nova:port>
Oct 20 18:37:45 user nova-compute[74233]:       </nova:ports>
Oct 20 18:37:45 user nova-compute[74233]:     </nova:instance>
Oct 20 18:37:45 user nova-compute[74233]:   </metadata>
Oct 20 18:37:45 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:37:45 user nova-compute[74233]:     <system>
Oct 20 18:37:45 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:37:45 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:37:45 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:37:45 user nova-compute[74233]:       <entry name="serial">f0309a68-e7f9-4a0a-84ac-5bb0794315be</entry>
Oct 20 18:37:45 user nova-compute[74233]:       <entry name="uuid">f0309a68-e7f9-4a0a-84ac-5bb0794315be</entry>
Oct 20 18:37:45 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:37:45 user nova-compute[74233]:     </system>
Oct 20 18:37:45 user nova-compute[74233]:   </sysinfo>
Oct 20 18:37:45 user nova-compute[74233]:   <os>
Oct 20 18:37:45 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:37:45 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:37:45 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:37:45 user nova-compute[74233]:   </os>
Oct 20 18:37:45 user nova-compute[74233]:   <features>
Oct 20 18:37:45 user nova-compute[74233]:     <acpi/>
Oct 20 18:37:45 user nova-compute[74233]:     <apic/>
Oct 20 18:37:45 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:37:45 user nova-compute[74233]:   </features>
Oct 20 18:37:45 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:37:45 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:37:45 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:37:45 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:37:45 user nova-compute[74233]:   </clock>
Oct 20 18:37:45 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:37:45 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:37:45 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:37:45 user nova-compute[74233]:   </cpu>
Oct 20 18:37:45 user nova-compute[74233]:   <devices>
Oct 20 18:37:45 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:37:45 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:37:45 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk"/>
Oct 20 18:37:45 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:37:45 user nova-compute[74233]:     </disk>
Oct 20 18:37:45 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:37:45 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:37:45 user nova-compute[74233]:       <source dev="/dev/sdc"/>
Oct 20 18:37:45 user nova-compute[74233]:       <target dev="vdc" bus="virtio"/>
Oct 20 18:37:45 user nova-compute[74233]:       <serial>f0485bd1-59f4-450d-af14-68758067dcac</serial>
Oct 20 18:37:45 user nova-compute[74233]:     </disk>
Oct 20 18:37:45 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:37:45 user nova-compute[74233]:       <mac address="fa:16:3e:a2:32:c6"/>
Oct 20 18:37:45 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:37:45 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:37:45 user nova-compute[74233]:       <target dev="tap931fbf57-df"/>
Oct 20 18:37:45 user nova-compute[74233]:     </interface>
Oct 20 18:37:45 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:37:45 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/console.log" append="off"/>
Oct 20 18:37:45 user nova-compute[74233]:     </serial>
Oct 20 18:37:45 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:37:45 user nova-compute[74233]:     <video>
Oct 20 18:37:45 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:37:45 user nova-compute[74233]:     </video>
Oct 20 18:37:45 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:37:45 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:37:45 user nova-compute[74233]:     </rng>
Oct 20 18:37:45 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:37:45 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:37:45 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:37:45 user nova-compute[74233]:     </memballoon>
Oct 20 18:37:45 user nova-compute[74233]:   </devices>
Oct 20 18:37:45 user nova-compute[74233]: </domain>
Oct 20 18:37:45 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1393302681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1393302681',id=41,image_ref='7256fea0-e733-456b-b58b-d05c2111dc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-893393640',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-fjkx79sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member',shelved_at='2023-10-20T18:35:23.442043',shelved_host='user',shelved_image_id='7256fea0-e733-456b-b58b-d05c2111dc31'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f0309a68-e7f9-4a0a-84ac-5bb0794315be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG os_vif [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '744a1429-cbba-5226-9257-9f8229a106f6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap931fbf57-df, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap931fbf57-df, col_values=(('qos', UUID('1d05445b-576c-404f-b07f-affc5f6dbb57')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap931fbf57-df, col_values=(('external_ids', {'iface-id': '931fbf57-df65-4214-b135-c6a4be7374d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:32:c6', 'vm-uuid': 'f0309a68-e7f9-4a0a-84ac-5bb0794315be'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:45 user nova-compute[74233]: INFO os_vif [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df')
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:37:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No VIF found with MAC fa:16:3e:a2:32:c6, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-44bfb0e7-5ef4-4366-9a14-f23d0c0808e9 req-f843994a-ae94-49ac-b79e-cf92efe1cc1b service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-44bfb0e7-5ef4-4366-9a14-f23d0c0808e9 req-f843994a-ae94-49ac-b79e-cf92efe1cc1b service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-44bfb0e7-5ef4-4366-9a14-f23d0c0808e9 req-f843994a-ae94-49ac-b79e-cf92efe1cc1b service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-44bfb0e7-5ef4-4366-9a14-f23d0c0808e9 req-f843994a-ae94-49ac-b79e-cf92efe1cc1b service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG nova.compute.manager [req-44bfb0e7-5ef4-4366-9a14-f23d0c0808e9 req-f843994a-ae94-49ac-b79e-cf92efe1cc1b service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:47 user nova-compute[74233]: WARNING nova.compute.manager [req-44bfb0e7-5ef4-4366-9a14-f23d0c0808e9 req-f843994a-ae94-49ac-b79e-cf92efe1cc1b service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 18:37:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:37:49 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance spawned successfully.
Oct 20 18:37:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-301f98dc-b77e-49cb-9862-7407cea83da8 req-750d7264-8383-49eb-9657-9854cd48a72f service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-301f98dc-b77e-49cb-9862-7407cea83da8 req-750d7264-8383-49eb-9657-9854cd48a72f service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-301f98dc-b77e-49cb-9862-7407cea83da8 req-750d7264-8383-49eb-9657-9854cd48a72f service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-301f98dc-b77e-49cb-9862-7407cea83da8 req-750d7264-8383-49eb-9657-9854cd48a72f service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:49 user nova-compute[74233]: DEBUG nova.compute.manager [req-301f98dc-b77e-49cb-9862-7407cea83da8 req-750d7264-8383-49eb-9657-9854cd48a72f service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:49 user nova-compute[74233]: WARNING nova.compute.manager [req-301f98dc-b77e-49cb-9862-7407cea83da8 req-750d7264-8383-49eb-9657-9854cd48a72f service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 18:37:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-b3093da1-37ce-4f83-9136-a5ba57e93ea2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 38.455s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:51 user nova-compute[74233]: INFO nova.compute.manager [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Terminating instance
Oct 20 18:37:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-94fecbf7-a42e-4646-a25a-72d20cb79da8 req-2accf2c3-1804-4309-87b3-6c4488c42be1 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-94fecbf7-a42e-4646-a25a-72d20cb79da8 req-2accf2c3-1804-4309-87b3-6c4488c42be1 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-94fecbf7-a42e-4646-a25a-72d20cb79da8 req-2accf2c3-1804-4309-87b3-6c4488c42be1 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-94fecbf7-a42e-4646-a25a-72d20cb79da8 req-2accf2c3-1804-4309-87b3-6c4488c42be1 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-94fecbf7-a42e-4646-a25a-72d20cb79da8 req-2accf2c3-1804-4309-87b3-6c4488c42be1 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:51 user nova-compute[74233]: DEBUG nova.compute.manager [req-94fecbf7-a42e-4646-a25a-72d20cb79da8 req-2accf2c3-1804-4309-87b3-6c4488c42be1 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Instance destroyed successfully.
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'resources' on Instance uuid 312f41b0-e549-4b33-be6f-350ec8f8f708 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-525089166',display_name='tempest-ServerActionsTestOtherA-server-525089166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-525089166',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-9gjpigga',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:35:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=312f41b0-e549-4b33-be6f-350ec8f8f708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "43351121-9b87-4f80-be17-6f02244b4ae4", "address": "fa:16:3e:9e:42:69", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43351121-9b", "ovs_interfaceid": "43351121-9b87-4f80-be17-6f02244b4ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_vif [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43351121-9b, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=037202ad-02f9-4975-b3ba-265f6629de70) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:37:52 user nova-compute[74233]: INFO os_vif [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:42:69,bridge_name='br-int',has_traffic_filtering=True,id=43351121-9b87-4f80-be17-6f02244b4ae4,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43351121-9b')
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlXgJQZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:37:52 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c030d1e6-9fe9-4e1a-aa55-5495a5d35802]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:37:52 user nova-compute[74233]: No targets found.
Oct 20 18:37:52 user nova-compute[74233]: iSNS:
Oct 20 18:37:52 user nova-compute[74233]: No targets found.
Oct 20 18:37:52 user nova-compute[74233]: STATIC:
Oct 20 18:37:52 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3
Oct 20 18:37:52 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:37:52 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:37:52 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac
Oct 20 18:37:52 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:37:52 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:37:52 user nova-compute[74233]: FIRMWARE:
Oct 20 18:37:52 user nova-compute[74233]: No targets found.
Oct 20 18:37:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:37:52 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:37:52 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab0ef1b-2f5c-467a-90ea-a63eafa88206]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fe03ba-1aaf-4eab-a953-51c57ccb8852]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:37:52 user nova-compute[74233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:37:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 (non-flash)
Oct 20 18:37:52 user nova-compute[74233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:37:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9504b63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee672ac1-76a4-48a6-b09c-cdaa73891e59]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb67e72-625b-478f-a2c3-40ddb7d59253]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[554717d3-e4a3-4016-99d4-e842a48e2b65]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.073s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd1b4a-4dff-40a4-96b9-4078da324fd7]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d53fc-0bfd-45f3-a71e-1bc2025d77b2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f5a419-108a-4816-bc7b-8d4fcfa717a4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260]
Oct 20 18:37:52 user nova-compute[74233]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3, portal: 172.16.0.220,3260] successful.
Oct 20 18:37:52 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb296a67-61a6-4156-86a3-a61d30c130b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b5753e-e5e9-4e1b-b50c-bbd1b3e31ec6]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] <== disconnect_volume: return (368ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:37:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Deleting instance files /opt/stack/data/nova/instances/312f41b0-e549-4b33-be6f-350ec8f8f708_del
Oct 20 18:37:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Deletion of /opt/stack/data/nova/instances/312f41b0-e549-4b33-be6f-350ec8f8f708_del complete
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:37:52 user nova-compute[74233]: INFO nova.compute.manager [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 20 18:37:52 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:37:52 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:37:53 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:37:53 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Took 0.71 seconds to deallocate network for instance.
Oct 20 18:37:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-83a7c2aa-ea00-4180-a542-ee1261131251 req-f43b5c6a-99c5-4d33-80aa-93fd76c04238 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-deleted-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:53 user nova-compute[74233]: INFO nova.compute.manager [req-83a7c2aa-ea00-4180-a542-ee1261131251 req-f43b5c6a-99c5-4d33-80aa-93fd76c04238 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Neutron deleted interface 43351121-9b87-4f80-be17-6f02244b4ae4; detaching it from the instance and deleting it from the info cache
Oct 20 18:37:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-83a7c2aa-ea00-4180-a542-ee1261131251 req-f43b5c6a-99c5-4d33-80aa-93fd76c04238 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:37:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-83a7c2aa-ea00-4180-a542-ee1261131251 req-f43b5c6a-99c5-4d33-80aa-93fd76c04238 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Detach interface failed, port_id=43351121-9b87-4f80-be17-6f02244b4ae4, reason: Instance 312f41b0-e549-4b33-be6f-350ec8f8f708 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:54 user nova-compute[74233]: WARNING nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state deleting.
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:54 user nova-compute[74233]: WARNING nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state deleting.
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:54 user nova-compute[74233]: WARNING nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state deleting.
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-unplugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Acquiring lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] No waiting events found dispatching network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:37:54 user nova-compute[74233]: WARNING nova.compute.manager [req-c6c18975-f1b1-4da7-9a39-fbf8d31b77f6 req-82e4d68f-6dfe-440e-9b6b-9a00041cda76 service nova] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Received unexpected event network-vif-plugged-43351121-9b87-4f80-be17-6f02244b4ae4 for instance with vm_state active and task_state deleting.
Oct 20 18:37:54 user nova-compute[74233]: INFO nova.compute.manager [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Took 0.90 seconds to detach 1 volumes for instance.
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 312f41b0-e549-4b33-be6f-350ec8f8f708] Deleting volume: bb296a67-61a6-4156-86a3-a61d30c130b3 {{(pid=74233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:37:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:54 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Deleted allocations for instance 312f41b0-e549-4b33-be6f-350ec8f8f708
Oct 20 18:37:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f2f9f1a5-fd34-4589-b77c-d9c64ee04525 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "312f41b0-e549-4b33-be6f-350ec8f8f708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.550s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:37:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:09 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:12 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:12 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:38:13 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:15 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:38:15 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.121341705322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 9d8f3218-2a57-452f-8251-2d5591c9f09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f0309a68-e7f9-4a0a-84ac-5bb0794315be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:38:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:38:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:38:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:38:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:38:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:38:51 user nova-compute[74233]: INFO nova.compute.claims [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Claim successful on node user
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:38:51 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:38:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:38:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG nova.policy [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e71fb6475d84e689b2016c0872ef187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90e93b65ab04d76a80f107110c16459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:38:52 user nova-compute[74233]: INFO nova.virt.block_device [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Booting with volume 39bfb05b-fbb3-4582-941e-6aeb44c884ca at /dev/vda
Oct 20 18:38:52 user nova-compute[74233]: DEBUG os_brick.utils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f1f20f-1d65-4368-a023-13ff99b5bbbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7169fa95-272b-4d8c-a4e9-8ec07bb91403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64b520-789c-41b8-9095-299bfbe8fabe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d3afa-c0cd-4824-8df9-24830d04e13e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:38:52 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:38:52 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c4b26-959d-4135-bf89-5af2f4d34a6e]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG os_brick.utils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating existing volume attachment record: a0e07d69-e57a-456f-98bc-3cb83806006e {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:52 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Successfully created port: 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Successfully updated port: 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing instance network info cache due to event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance network_info: |[{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:38:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:38:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated VIF entry in instance network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:38:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:38:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-2b99fa26-00f3-4ffc-8d3f-b45201813050 req-66799934-b11e-4ff4-b73f-46696dae0247 service nova] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:38:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:38:59 user nova-compute[74233]: INFO nova.compute.manager [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Terminating instance
Oct 20 18:38:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-6ece16d1-b947-4ec3-8250-e166199c3310 req-54fec790-60f1-4d8b-bed5-adca5d47d85c service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-vif-unplugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6ece16d1-b947-4ec3-8250-e166199c3310 req-54fec790-60f1-4d8b-bed5-adca5d47d85c service nova] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6ece16d1-b947-4ec3-8250-e166199c3310 req-54fec790-60f1-4d8b-bed5-adca5d47d85c service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6ece16d1-b947-4ec3-8250-e166199c3310 req-54fec790-60f1-4d8b-bed5-adca5d47d85c service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-6ece16d1-b947-4ec3-8250-e166199c3310 req-54fec790-60f1-4d8b-bed5-adca5d47d85c service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] No waiting events found dispatching network-vif-unplugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:38:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-6ece16d1-b947-4ec3-8250-e166199c3310 req-54fec790-60f1-4d8b-bed5-adca5d47d85c service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-vif-unplugged-6d5340b7-026b-4367-bf48-c710ffca8ace for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:39:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Instance destroyed successfully.
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.objects.instance [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lazy-loading 'resources' on Instance uuid 9d8f3218-2a57-452f-8251-2d5591c9f09a {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-304316832',display_name='tempest-ServerActionsTestOtherA-server-304316832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-304316832',id=26,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh45z1mJywX4rF3ko7MVJNG9e+JWeUgw9wxT1fars8DKbE8KFIV9ot6FoeG7VDQtettjF+K8mNaS0IvzaElaLTCRVlRSMvZkQW3AH6WVLJ7ExNf6ESNll/b+p76QVAIMA==',key_name='tempest-keypair-1582616380',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0083be86b8f04d16a891eadad4dccbe6',ramdisk_id='',reservation_id='r-2b1xpfku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-835796467',owner_user_name='tempest-ServerActionsTestOtherA-835796467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:18:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d132de50b442419e8f3a059e650902e7',uuid=9d8f3218-2a57-452f-8251-2d5591c9f09a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converting VIF {"id": "6d5340b7-026b-4367-bf48-c710ffca8ace", "address": "fa:16:3e:5d:de:fc", "network": {"id": "bccc5268-837f-4a33-b18c-b8579ba7b0c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-367867003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0083be86b8f04d16a891eadad4dccbe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5340b7-02", "ovs_interfaceid": "6d5340b7-026b-4367-bf48-c710ffca8ace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG os_vif [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d5340b7-02, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d901d177-13f7-4ed8-bc0b-c6a4c817a914) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:00 user nova-compute[74233]: INFO os_vif [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:de:fc,bridge_name='br-int',has_traffic_filtering=True,id=6d5340b7-026b-4367-bf48-c710ffca8ace,network=Network(bccc5268-837f-4a33-b18c-b8579ba7b0c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5340b7-02')
Oct 20 18:39:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Deleting instance files /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a_del
Oct 20 18:39:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Deletion of /opt/stack/data/nova/instances/9d8f3218-2a57-452f-8251-2d5591c9f09a_del complete
Oct 20 18:39:00 user nova-compute[74233]: INFO nova.compute.manager [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 18:39:00 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:39:00 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Took 0.47 seconds to deallocate network for instance.
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.compute.manager [req-4a086a01-357b-4310-8ac5-f771892fee87 req-c9809f38-fbbc-4503-9f0c-93ea8ff37717 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-vif-deleted-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:39:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:00 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Deleted allocations for instance 9d8f3218-2a57-452f-8251-2d5591c9f09a
Oct 20 18:39:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-210db7c4-2c9c-4702-8f06-a9f0fb3f0632 tempest-ServerActionsTestOtherA-835796467 tempest-ServerActionsTestOtherA-835796467-project-member] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.662s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:01 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:01 user nova-compute[74233]: INFO nova.compute.manager [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Detaching volume f0485bd1-59f4-450d-af14-68758067dcac
Oct 20 18:39:01 user nova-compute[74233]: INFO nova.virt.block_device [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Attempting to driver detach volume f0485bd1-59f4-450d-af14-68758067dcac from mountpoint /dev/vdc
Oct 20 18:39:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Attempting to detach device vdc from instance f0309a68-e7f9-4a0a-84ac-5bb0794315be from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:39:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:39:01 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:39:01 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:39:01 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:39:01 user nova-compute[74233]:   <serial>f0485bd1-59f4-450d-af14-68758067dcac</serial>
Oct 20 18:39:01 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 18:39:01 user nova-compute[74233]: </disk>
Oct 20 18:39:01 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:39:01 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully detached device vdc from instance f0309a68-e7f9-4a0a-84ac-5bb0794315be from the persistent domain config.
Oct 20 18:39:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f0309a68-e7f9-4a0a-84ac-5bb0794315be from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:39:01 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:39:01 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:39:01 user nova-compute[74233]:   <source dev="/dev/sdc"/>
Oct 20 18:39:01 user nova-compute[74233]:   <target dev="vdc" bus="virtio"/>
Oct 20 18:39:01 user nova-compute[74233]:   <serial>f0485bd1-59f4-450d-af14-68758067dcac</serial>
Oct 20 18:39:01 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 18:39:01 user nova-compute[74233]: </disk>
Oct 20 18:39:01 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:39:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:39:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-67358c55-bba2-488f-972c-86654d2a0a62 req-43c39632-9349-4aba-879a-9cabdcf5f051 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received event network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-67358c55-bba2-488f-972c-86654d2a0a62 req-43c39632-9349-4aba-879a-9cabdcf5f051 service nova] Acquiring lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-67358c55-bba2-488f-972c-86654d2a0a62 req-43c39632-9349-4aba-879a-9cabdcf5f051 service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-67358c55-bba2-488f-972c-86654d2a0a62 req-43c39632-9349-4aba-879a-9cabdcf5f051 service nova] Lock "9d8f3218-2a57-452f-8251-2d5591c9f09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:02 user nova-compute[74233]: DEBUG nova.compute.manager [req-67358c55-bba2-488f-972c-86654d2a0a62 req-43c39632-9349-4aba-879a-9cabdcf5f051 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] No waiting events found dispatching network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:39:02 user nova-compute[74233]: WARNING nova.compute.manager [req-67358c55-bba2-488f-972c-86654d2a0a62 req-43c39632-9349-4aba-879a-9cabdcf5f051 service nova] [instance: 9d8f3218-2a57-452f-8251-2d5591c9f09a] Received unexpected event network-vif-plugged-6d5340b7-026b-4367-bf48-c710ffca8ace for instance with vm_state deleted and task_state None.
Oct 20 18:39:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:39:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Creating image(s)
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Ensure instance console log exists: /opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Start _get_guest_xml network_info=[{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'a0e07d69-e57a-456f-98bc-3cb83806006e', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47cd9fde-110d-44c1-bae7-75885f66a199', 'attached_at': '', 'detached_at': '', 'volume_id': '39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'serial': '39bfb05b-fbb3-4582-941e-6aeb44c884ca'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:39:14 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:39:14 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:39:14 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:39:14 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:39:14 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c783ed-6316-423e-99bf-e8545fd2b81d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:39:14 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d0601f-706c-4cfa-9890-2fa56f8cbf7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca] added
Oct 20 18:39:14 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac3a58b-dace-4089-b35b-38ce4e2c851b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[046cae56-b59a-4267-b109-de844642ce45]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PitsqvfF {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PitsqvfF" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d01d97e-f13e-4c36-ae4f-3259a4ea298d]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PitsqvfF'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e55d58-3092-475d-a937-77ff68cd5453]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2cbd49-99ae-41d7-977b-41cf86c2067a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:39:14 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:39:14 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbef4f5-1e4c-4445-b4e3-311b69e1e7fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]
Oct 20 18:39:14 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.
Oct 20 18:39:14 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d61bde-928d-43e6-bb81-82231c17ac5a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a6af6-5337-4e6c-be90-c8ac194c9e86]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:39:14 user nova-compute[74233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:39:14 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:39:14 user nova-compute[74233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:39:14 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdadaca-295d-46b9-aa34-7ce8bc667836]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:39:14 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23231336538366663', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231336538366663', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1821826801',display_name='tempest-TestShelveInstance-server-1821826801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1821826801',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqbuVnvRbghTfPyL8JSJuo8jPcxCFUF/HXHUr795ZoQaUSHPMV6dQduEGs6gQKY0DkTCeZdf2HwfgDho4LUzcfLu6PVrhxtUNf2OR9Oyqr/hOVopI20oPadvE3inV/+RA==',key_name='tempest-TestShelveInstance-1392667661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e90e93b65ab04d76a80f107110c16459',ramdisk_id='',reservation_id='r-imi3gsbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1210267954',owner_user_name='tempest-TestShelveInstance-1210267954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:38:52Z,user_data=None,user_id='1e71fb6475d84e689b2016c0872ef187',uuid=47cd9fde-110d-44c1-bae7-75885f66a199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converting VIF {"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:39:15 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'pci_devices' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:39:16 user nova-compute[74233]:   <uuid>47cd9fde-110d-44c1-bae7-75885f66a199</uuid>
Oct 20 18:39:16 user nova-compute[74233]:   <name>instance-0000002b</name>
Oct 20 18:39:16 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:39:16 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:39:16 user nova-compute[74233]:   <metadata>
Oct 20 18:39:16 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:39:16 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:39:16 user nova-compute[74233]:       <nova:name>tempest-TestShelveInstance-server-1821826801</nova:name>
Oct 20 18:39:16 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:39:14</nova:creationTime>
Oct 20 18:39:16 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:39:16 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:39:16 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:39:16 user nova-compute[74233]:       <nova:owner>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:user uuid="1e71fb6475d84e689b2016c0872ef187">tempest-TestShelveInstance-1210267954-project-member</nova:user>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:project uuid="e90e93b65ab04d76a80f107110c16459">tempest-TestShelveInstance-1210267954</nova:project>
Oct 20 18:39:16 user nova-compute[74233]:       </nova:owner>
Oct 20 18:39:16 user nova-compute[74233]:       <nova:ports>
Oct 20 18:39:16 user nova-compute[74233]:         <nova:port uuid="796876e4-b026-4c5c-8ac5-999b5d7774ad">
Oct 20 18:39:16 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:39:16 user nova-compute[74233]:         </nova:port>
Oct 20 18:39:16 user nova-compute[74233]:       </nova:ports>
Oct 20 18:39:16 user nova-compute[74233]:     </nova:instance>
Oct 20 18:39:16 user nova-compute[74233]:   </metadata>
Oct 20 18:39:16 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:39:16 user nova-compute[74233]:     <system>
Oct 20 18:39:16 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:39:16 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:39:16 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:39:16 user nova-compute[74233]:       <entry name="serial">47cd9fde-110d-44c1-bae7-75885f66a199</entry>
Oct 20 18:39:16 user nova-compute[74233]:       <entry name="uuid">47cd9fde-110d-44c1-bae7-75885f66a199</entry>
Oct 20 18:39:16 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:39:16 user nova-compute[74233]:     </system>
Oct 20 18:39:16 user nova-compute[74233]:   </sysinfo>
Oct 20 18:39:16 user nova-compute[74233]:   <os>
Oct 20 18:39:16 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:39:16 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:39:16 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:39:16 user nova-compute[74233]:   </os>
Oct 20 18:39:16 user nova-compute[74233]:   <features>
Oct 20 18:39:16 user nova-compute[74233]:     <acpi/>
Oct 20 18:39:16 user nova-compute[74233]:     <apic/>
Oct 20 18:39:16 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:39:16 user nova-compute[74233]:   </features>
Oct 20 18:39:16 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:39:16 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:39:16 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:39:16 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:39:16 user nova-compute[74233]:   </clock>
Oct 20 18:39:16 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:39:16 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:39:16 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:39:16 user nova-compute[74233]:   </cpu>
Oct 20 18:39:16 user nova-compute[74233]:   <devices>
Oct 20 18:39:16 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:39:16 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:39:16 user nova-compute[74233]:       <source dev="/dev/sdb"/>
Oct 20 18:39:16 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:39:16 user nova-compute[74233]:       <serial>39bfb05b-fbb3-4582-941e-6aeb44c884ca</serial>
Oct 20 18:39:16 user nova-compute[74233]:     </disk>
Oct 20 18:39:16 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:39:16 user nova-compute[74233]:       <mac address="fa:16:3e:d7:57:6b"/>
Oct 20 18:39:16 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:39:16 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:39:16 user nova-compute[74233]:       <target dev="tap796876e4-b0"/>
Oct 20 18:39:16 user nova-compute[74233]:     </interface>
Oct 20 18:39:16 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:39:16 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199/console.log" append="off"/>
Oct 20 18:39:16 user nova-compute[74233]:     </serial>
Oct 20 18:39:16 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:39:16 user nova-compute[74233]:     <video>
Oct 20 18:39:16 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:39:16 user nova-compute[74233]:     </video>
Oct 20 18:39:16 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:39:16 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:39:16 user nova-compute[74233]:     </rng>
Oct 20 18:39:16 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:39:16 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:39:16 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:39:16 user nova-compute[74233]:     </memballoon>
Oct 20 18:39:16 user nova-compute[74233]:   </devices>
Oct 20 18:39:16 user nova-compute[74233]: </domain>
Oct 20 18:39:16 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1821826801',display_name='tempest-TestShelveInstance-server-1821826801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1821826801',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqbuVnvRbghTfPyL8JSJuo8jPcxCFUF/HXHUr795ZoQaUSHPMV6dQduEGs6gQKY0DkTCeZdf2HwfgDho4LUzcfLu6PVrhxtUNf2OR9Oyqr/hOVopI20oPadvE3inV/+RA==',key_name='tempest-TestShelveInstance-1392667661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e90e93b65ab04d76a80f107110c16459',ramdisk_id='',reservation_id='r-imi3gsbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1210267954',owner_user_name='tempest-TestShelveInstance-1210267954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:38:52Z,user_data=None,user_id='1e71fb6475d84e689b2016c0872ef187',uuid=47cd9fde-110d-44c1-bae7-75885f66a199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converting VIF {"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG os_vif [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55ee1af7-04a4-5b26-a8f5-0347dbe95f41', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap796876e4-b0, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap796876e4-b0, col_values=(('qos', UUID('e05a15e6-4e99-4240-8c12-39ffa1fefe56')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap796876e4-b0, col_values=(('external_ids', {'iface-id': '796876e4-b026-4c5c-8ac5-999b5d7774ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:57:6b', 'vm-uuid': '47cd9fde-110d-44c1-bae7-75885f66a199'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:16 user nova-compute[74233]: INFO os_vif [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0')
Oct 20 18:39:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] No VIF found with MAC fa:16:3e:d7:57:6b, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:16 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:39:16 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=25.13836669921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f0309a68-e7f9-4a0a-84ac-5bb0794315be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 47cd9fde-110d-44c1-bae7-75885f66a199 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:39:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-4b934ae4-416a-4d8d-bfb7-7adebca97e54 req-a4bfa742-9965-47a9-9b96-64da08c98bab service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4b934ae4-416a-4d8d-bfb7-7adebca97e54 req-a4bfa742-9965-47a9-9b96-64da08c98bab service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4b934ae4-416a-4d8d-bfb7-7adebca97e54 req-a4bfa742-9965-47a9-9b96-64da08c98bab service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-4b934ae4-416a-4d8d-bfb7-7adebca97e54 req-a4bfa742-9965-47a9-9b96-64da08c98bab service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-4b934ae4-416a-4d8d-bfb7-7adebca97e54 req-a4bfa742-9965-47a9-9b96-64da08c98bab service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:39:17 user nova-compute[74233]: WARNING nova.compute.manager [req-4b934ae4-416a-4d8d-bfb7-7adebca97e54 req-a4bfa742-9965-47a9-9b96-64da08c98bab service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state building and task_state spawning.
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:39:19 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance spawned successfully.
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:39:19 user nova-compute[74233]: INFO nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:39:19 user nova-compute[74233]: INFO nova.compute.manager [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Took 27.99 seconds to build instance.
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-c9ff3b16-df29-467d-a8fe-15f8a1331753 req-070fd782-2d23-47d9-94b2-9efb16c7a352 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c9ff3b16-df29-467d-a8fe-15f8a1331753 req-070fd782-2d23-47d9-94b2-9efb16c7a352 service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c9ff3b16-df29-467d-a8fe-15f8a1331753 req-070fd782-2d23-47d9-94b2-9efb16c7a352 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c9ff3b16-df29-467d-a8fe-15f8a1331753 req-070fd782-2d23-47d9-94b2-9efb16c7a352 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG nova.compute.manager [req-c9ff3b16-df29-467d-a8fe-15f8a1331753 req-070fd782-2d23-47d9-94b2-9efb16c7a352 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:39:19 user nova-compute[74233]: WARNING nova.compute.manager [req-c9ff3b16-df29-467d-a8fe-15f8a1331753 req-070fd782-2d23-47d9-94b2-9efb16c7a352 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state active and task_state None.
Oct 20 18:39:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cabb6b96-8cf1-4d85-85e8-2a8123cac282 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.088s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:22 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f0309a68-e7f9-4a0a-84ac-5bb0794315be is timed out.
Oct 20 18:39:22 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully detached device vdc from instance f0309a68-e7f9-4a0a-84ac-5bb0794315be from the live domain config.
Oct 20 18:39:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syiHnFDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:39:22 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafec64e-756e-415c-b86d-6e518d458105]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:39:22 user nova-compute[74233]: No targets found.
Oct 20 18:39:22 user nova-compute[74233]: iSNS:
Oct 20 18:39:22 user nova-compute[74233]: No targets found.
Oct 20 18:39:22 user nova-compute[74233]: STATIC:
Oct 20 18:39:22 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca
Oct 20 18:39:22 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:39:22 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:39:22 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac
Oct 20 18:39:22 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:39:22 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:39:22 user nova-compute[74233]: FIRMWARE:
Oct 20 18:39:22 user nova-compute[74233]: No targets found.
Oct 20 18:39:22 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:39:22 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:39:22 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe045da2-2a39-4e0a-985d-d7c77201c31c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c14f1-ed3b-4f5b-9dd1-e4dd64004046]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:39:22 user nova-compute[74233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:39:22 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac (non-flash)
Oct 20 18:39:22 user nova-compute[74233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:39:22 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950471b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b50a1f-fd25-4500-ba35-782b6882fa3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f39ca-a13b-470f-88ff-0f4bd1b7f0d6]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3393aea-21b4-4fe6-a595-5055b244a267]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1edc443-67ea-4d25-af82-c6164e404f88]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[908aad53-1cfe-4a33-b8d3-ff737f619300]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f941f2c-f68d-4869-9aff-907a004fd3bd]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260]
Oct 20 18:39:22 user nova-compute[74233]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac, portal: 172.16.0.220,3260] successful.
Oct 20 18:39:22 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0485bd1-59f4-450d-af14-68758067dcac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675aae1-6bf7-47e2-9624-4b9107e3efd9]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] <== disconnect_volume: return (306ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:39:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:23 user nova-compute[74233]: DEBUG nova.objects.instance [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'flavor' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:39:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-14ddaf9e-df35-48ef-afb4-139f3665c5b2 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:39:24 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:39:25 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:39:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:39:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:39:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:52 user nova-compute[74233]: INFO nova.compute.manager [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Terminating instance
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-d99a523b-7f5c-4fc4-9cbf-781461f05faa req-121c4d8a-9bfb-46f8-b9b4-6a9384e6c742 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-unplugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d99a523b-7f5c-4fc4-9cbf-781461f05faa req-121c4d8a-9bfb-46f8-b9b4-6a9384e6c742 service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d99a523b-7f5c-4fc4-9cbf-781461f05faa req-121c4d8a-9bfb-46f8-b9b4-6a9384e6c742 service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d99a523b-7f5c-4fc4-9cbf-781461f05faa req-121c4d8a-9bfb-46f8-b9b4-6a9384e6c742 service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-d99a523b-7f5c-4fc4-9cbf-781461f05faa req-121c4d8a-9bfb-46f8-b9b4-6a9384e6c742 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-unplugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-d99a523b-7f5c-4fc4-9cbf-781461f05faa req-121c4d8a-9bfb-46f8-b9b4-6a9384e6c742 service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-unplugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Instance destroyed successfully.
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'resources' on Instance uuid f0309a68-e7f9-4a0a-84ac-5bb0794315be {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1393302681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1393302681',id=41,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4rklmJ1LGAqZWHX4SPY8EYpE9I39QL0J+AH8+zEwRZ/0B/bkgavKFtoka6akRq5raqRWRLP9Z8iaIGuwcJV9GHLODx0yR7Cq58Q3Li1bGzisL3e3an3Wr5/ovfXLTuA==',key_name='tempest-keypair-893393640',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:37:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-fjkx79sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f0309a68-e7f9-4a0a-84ac-5bb0794315be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "931fbf57-df65-4214-b135-c6a4be7374d3", "address": "fa:16:3e:a2:32:c6", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap931fbf57-df", "ovs_interfaceid": "931fbf57-df65-4214-b135-c6a4be7374d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG os_vif [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap931fbf57-df, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d05445b-576c-404f-b07f-affc5f6dbb57) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:39:52 user nova-compute[74233]: INFO os_vif [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:32:c6,bridge_name='br-int',has_traffic_filtering=True,id=931fbf57-df65-4214-b135-c6a4be7374d3,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap931fbf57-df')
Oct 20 18:39:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Deleting instance files /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be_del
Oct 20 18:39:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Deletion of /opt/stack/data/nova/instances/f0309a68-e7f9-4a0a-84ac-5bb0794315be_del complete
Oct 20 18:39:52 user nova-compute[74233]: INFO nova.compute.manager [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 18:39:52 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:39:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:39:53 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Took 0.72 seconds to deallocate network for instance.
Oct 20 18:39:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-c13f3ce6-633a-48e5-b4c8-1ee4f6822548 req-7f21a992-e477-46ea-9f2f-ededce64df0e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-deleted-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:53 user nova-compute[74233]: INFO nova.compute.manager [req-c13f3ce6-633a-48e5-b4c8-1ee4f6822548 req-7f21a992-e477-46ea-9f2f-ededce64df0e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Neutron deleted interface 931fbf57-df65-4214-b135-c6a4be7374d3; detaching it from the instance and deleting it from the info cache
Oct 20 18:39:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-c13f3ce6-633a-48e5-b4c8-1ee4f6822548 req-7f21a992-e477-46ea-9f2f-ededce64df0e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-c13f3ce6-633a-48e5-b4c8-1ee4f6822548 req-7f21a992-e477-46ea-9f2f-ededce64df0e service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Detach interface failed, port_id=931fbf57-df65-4214-b135-c6a4be7374d3, reason: Instance f0309a68-e7f9-4a0a-84ac-5bb0794315be could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:39:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:53 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Deleted allocations for instance f0309a68-e7f9-4a0a-84ac-5bb0794315be
Oct 20 18:39:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-40970088-bc90-441b-b39d-9915b1252271 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.962s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-89c901e3-15a4-43b0-b257-ddaa7a4cc6f4 req-3cdf2ebe-9916-4364-86b6-fd2cfabaa37a service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:39:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-89c901e3-15a4-43b0-b257-ddaa7a4cc6f4 req-3cdf2ebe-9916-4364-86b6-fd2cfabaa37a service nova] Acquiring lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:39:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-89c901e3-15a4-43b0-b257-ddaa7a4cc6f4 req-3cdf2ebe-9916-4364-86b6-fd2cfabaa37a service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:39:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-89c901e3-15a4-43b0-b257-ddaa7a4cc6f4 req-3cdf2ebe-9916-4364-86b6-fd2cfabaa37a service nova] Lock "f0309a68-e7f9-4a0a-84ac-5bb0794315be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:39:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-89c901e3-15a4-43b0-b257-ddaa7a4cc6f4 req-3cdf2ebe-9916-4364-86b6-fd2cfabaa37a service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] No waiting events found dispatching network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:39:54 user nova-compute[74233]: WARNING nova.compute.manager [req-89c901e3-15a4-43b0-b257-ddaa7a4cc6f4 req-3cdf2ebe-9916-4364-86b6-fd2cfabaa37a service nova] [instance: f0309a68-e7f9-4a0a-84ac-5bb0794315be] Received unexpected event network-vif-plugged-931fbf57-df65-4214-b135-c6a4be7374d3 for instance with vm_state deleted and task_state None.
Oct 20 18:39:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:39:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:40:02 user nova-compute[74233]: INFO nova.compute.claims [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Claim successful on node user
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:40:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:40:02 user nova-compute[74233]: DEBUG nova.policy [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efaee4f6f36e458184f3aa737affdbc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a650cec6e38447d5a36decea9b4f4a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:40:03 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Creating image(s)
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk 1073741824" returned: 0 in 0.048s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Successfully created port: bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Cannot resize image /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Ensure instance console log exists: /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Successfully updated port: bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquired lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-changed-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Refreshing instance network info cache due to event network-changed-bc716143-0f5a-4fa8-86b2-41682e1932de. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] Acquiring lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Releasing lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Instance network_info: |[{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] Acquired lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Refreshing network info cache for port bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Start _get_guest_xml network_info=[{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:40:04 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:40:04 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-166168778',display_name='tempest-AttachVolumeNegativeTest-server-166168778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-166168778',id=44,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIDZcUnJsTz719RWInyQoPd68YKlOE4Lib7c0ltc0gDw/4X0ubnM+jIm/mZcgck/yymmY5j10r7Dlnz/z1cYA0fQ/GXsVDPjZW3X/W1STKW8Kx26ygatCLt/5FkZFLBKw==',key_name='tempest-keypair-1915939227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-phyvslj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=f9602450-159a-4e44-81fe-966940c09ec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.objects.instance [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'pci_devices' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:40:04 user nova-compute[74233]:   <uuid>f9602450-159a-4e44-81fe-966940c09ec1</uuid>
Oct 20 18:40:04 user nova-compute[74233]:   <name>instance-0000002c</name>
Oct 20 18:40:04 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:40:04 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:40:04 user nova-compute[74233]:   <metadata>
Oct 20 18:40:04 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:40:04 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:40:04 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-166168778</nova:name>
Oct 20 18:40:04 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:40:04</nova:creationTime>
Oct 20 18:40:04 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:40:04 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:40:04 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:40:04 user nova-compute[74233]:       <nova:owner>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:user uuid="efaee4f6f36e458184f3aa737affdbc2">tempest-AttachVolumeNegativeTest-375409870-project-member</nova:user>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:project uuid="a650cec6e38447d5a36decea9b4f4a30">tempest-AttachVolumeNegativeTest-375409870</nova:project>
Oct 20 18:40:04 user nova-compute[74233]:       </nova:owner>
Oct 20 18:40:04 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:40:04 user nova-compute[74233]:       <nova:ports>
Oct 20 18:40:04 user nova-compute[74233]:         <nova:port uuid="bc716143-0f5a-4fa8-86b2-41682e1932de">
Oct 20 18:40:04 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:40:04 user nova-compute[74233]:         </nova:port>
Oct 20 18:40:04 user nova-compute[74233]:       </nova:ports>
Oct 20 18:40:04 user nova-compute[74233]:     </nova:instance>
Oct 20 18:40:04 user nova-compute[74233]:   </metadata>
Oct 20 18:40:04 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:40:04 user nova-compute[74233]:     <system>
Oct 20 18:40:04 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:40:04 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:40:04 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:40:04 user nova-compute[74233]:       <entry name="serial">f9602450-159a-4e44-81fe-966940c09ec1</entry>
Oct 20 18:40:04 user nova-compute[74233]:       <entry name="uuid">f9602450-159a-4e44-81fe-966940c09ec1</entry>
Oct 20 18:40:04 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:40:04 user nova-compute[74233]:     </system>
Oct 20 18:40:04 user nova-compute[74233]:   </sysinfo>
Oct 20 18:40:04 user nova-compute[74233]:   <os>
Oct 20 18:40:04 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:40:04 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:40:04 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:40:04 user nova-compute[74233]:   </os>
Oct 20 18:40:04 user nova-compute[74233]:   <features>
Oct 20 18:40:04 user nova-compute[74233]:     <acpi/>
Oct 20 18:40:04 user nova-compute[74233]:     <apic/>
Oct 20 18:40:04 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:40:04 user nova-compute[74233]:   </features>
Oct 20 18:40:04 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:40:04 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:40:04 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:40:04 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:40:04 user nova-compute[74233]:   </clock>
Oct 20 18:40:04 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:40:04 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:40:04 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:40:04 user nova-compute[74233]:   </cpu>
Oct 20 18:40:04 user nova-compute[74233]:   <devices>
Oct 20 18:40:04 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:40:04 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:40:04 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk"/>
Oct 20 18:40:04 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:40:04 user nova-compute[74233]:     </disk>
Oct 20 18:40:04 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:40:04 user nova-compute[74233]:       <mac address="fa:16:3e:83:89:a3"/>
Oct 20 18:40:04 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:40:04 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:40:04 user nova-compute[74233]:       <target dev="tapbc716143-0f"/>
Oct 20 18:40:04 user nova-compute[74233]:     </interface>
Oct 20 18:40:04 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:40:04 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/console.log" append="off"/>
Oct 20 18:40:04 user nova-compute[74233]:     </serial>
Oct 20 18:40:04 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:40:04 user nova-compute[74233]:     <video>
Oct 20 18:40:04 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:40:04 user nova-compute[74233]:     </video>
Oct 20 18:40:04 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:40:04 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:40:04 user nova-compute[74233]:     </rng>
Oct 20 18:40:04 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:40:04 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:40:04 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:40:04 user nova-compute[74233]:     </memballoon>
Oct 20 18:40:04 user nova-compute[74233]:   </devices>
Oct 20 18:40:04 user nova-compute[74233]: </domain>
Oct 20 18:40:04 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-166168778',display_name='tempest-AttachVolumeNegativeTest-server-166168778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-166168778',id=44,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIDZcUnJsTz719RWInyQoPd68YKlOE4Lib7c0ltc0gDw/4X0ubnM+jIm/mZcgck/yymmY5j10r7Dlnz/z1cYA0fQ/GXsVDPjZW3X/W1STKW8Kx26ygatCLt/5FkZFLBKw==',key_name='tempest-keypair-1915939227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-phyvslj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=f9602450-159a-4e44-81fe-966940c09ec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG os_vif [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '475fa03e-fb31-53f5-bc6f-248beb46c01e', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc716143-0f, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc716143-0f, col_values=(('qos', UUID('cce4c0a5-00e8-49ae-b105-2a8335eb5d9b')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc716143-0f, col_values=(('external_ids', {'iface-id': 'bc716143-0f5a-4fa8-86b2-41682e1932de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:89:a3', 'vm-uuid': 'f9602450-159a-4e44-81fe-966940c09ec1'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:04 user nova-compute[74233]: INFO os_vif [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f')
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:83:89:a3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updated VIF entry in instance network info cache for port bc716143-0f5a-4fa8-86b2-41682e1932de. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-16625610-41d1-4583-871f-97ef77ad9787 req-48be6064-54b2-4f43-827e-eaadb3d2003c service nova] Releasing lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-e5a9d8b9-eb88-49fd-aea2-c0c7de80c5d7 req-0145722f-5a38-4d61-8c43-6588c8798d3d service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5a9d8b9-eb88-49fd-aea2-c0c7de80c5d7 req-0145722f-5a38-4d61-8c43-6588c8798d3d service nova] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5a9d8b9-eb88-49fd-aea2-c0c7de80c5d7 req-0145722f-5a38-4d61-8c43-6588c8798d3d service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e5a9d8b9-eb88-49fd-aea2-c0c7de80c5d7 req-0145722f-5a38-4d61-8c43-6588c8798d3d service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-e5a9d8b9-eb88-49fd-aea2-c0c7de80c5d7 req-0145722f-5a38-4d61-8c43-6588c8798d3d service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] No waiting events found dispatching network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:40:06 user nova-compute[74233]: WARNING nova.compute.manager [req-e5a9d8b9-eb88-49fd-aea2-c0c7de80c5d7 req-0145722f-5a38-4d61-8c43-6588c8798d3d service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received unexpected event network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de for instance with vm_state building and task_state spawning.
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:40:08 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Instance spawned successfully.
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:08 user nova-compute[74233]: INFO nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:40:08 user nova-compute[74233]: INFO nova.compute.manager [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Took 5.76 seconds to build instance.
Oct 20 18:40:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-d6b6f015-d8c4-46ef-ab2f-d772cf7178f8 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.863s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-84fd1c36-b400-46cc-9785-7b03c3c602f3 req-fe83ed09-85a6-491f-929d-5a1746239fc0 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-84fd1c36-b400-46cc-9785-7b03c3c602f3 req-fe83ed09-85a6-491f-929d-5a1746239fc0 service nova] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-84fd1c36-b400-46cc-9785-7b03c3c602f3 req-fe83ed09-85a6-491f-929d-5a1746239fc0 service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-84fd1c36-b400-46cc-9785-7b03c3c602f3 req-fe83ed09-85a6-491f-929d-5a1746239fc0 service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-84fd1c36-b400-46cc-9785-7b03c3c602f3 req-fe83ed09-85a6-491f-929d-5a1746239fc0 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] No waiting events found dispatching network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:40:08 user nova-compute[74233]: WARNING nova.compute.manager [req-84fd1c36-b400-46cc-9785-7b03c3c602f3 req-fe83ed09-85a6-491f-929d-5a1746239fc0 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received unexpected event network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de for instance with vm_state active and task_state None.
Oct 20 18:40:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:40:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:40:16 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:17 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:40:17 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.163066864013672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 47cd9fde-110d-44c1-bae7-75885f66a199 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:40:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:26 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:40:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:40:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:40:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing instance network info cache due to event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:40:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:42 user nova-compute[74233]: DEBUG nova.network.neutron [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG nova.network.neutron [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated VIF entry in instance network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG nova.network.neutron [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f3a8e8e1-9dbe-4355-830f-89ecfe8162b3 req-5919b310-888f-4978-859d-d56eea294ee0 service nova] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:43 user nova-compute[74233]: INFO nova.compute.manager [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Shelve offloading
Oct 20 18:40:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0e755f6-d625-4371-8c44-fc1e44a65668 req-2624af54-0adb-4118-9da8-f8b5dc6f2b7a service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-unplugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0e755f6-d625-4371-8c44-fc1e44a65668 req-2624af54-0adb-4118-9da8-f8b5dc6f2b7a service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0e755f6-d625-4371-8c44-fc1e44a65668 req-2624af54-0adb-4118-9da8-f8b5dc6f2b7a service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a0e755f6-d625-4371-8c44-fc1e44a65668 req-2624af54-0adb-4118-9da8-f8b5dc6f2b7a service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-a0e755f6-d625-4371-8c44-fc1e44a65668 req-2624af54-0adb-4118-9da8-f8b5dc6f2b7a service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-unplugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:40:43 user nova-compute[74233]: WARNING nova.compute.manager [req-a0e755f6-d625-4371-8c44-fc1e44a65668 req-2624af54-0adb-4118-9da8-f8b5dc6f2b7a service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-unplugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state active and task_state shelving.
Oct 20 18:40:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance destroyed successfully.
Oct 20 18:40:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:40:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:44 user nova-compute[74233]: DEBUG nova.network.neutron [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:40:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:44 user nova-compute[74233]: DEBUG nova.network.neutron [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance destroyed successfully.
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.objects.instance [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'resources' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1821826801',display_name='tempest-TestShelveInstance-server-1821826801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1821826801',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqbuVnvRbghTfPyL8JSJuo8jPcxCFUF/HXHUr795ZoQaUSHPMV6dQduEGs6gQKY0DkTCeZdf2HwfgDho4LUzcfLu6PVrhxtUNf2OR9Oyqr/hOVopI20oPadvE3inV/+RA==',key_name='tempest-TestShelveInstance-1392667661',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e90e93b65ab04d76a80f107110c16459',ramdisk_id='',reservation_id='r-imi3gsbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1210267954',owner_user_name='tempest-TestShelveInstance-1210267954-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:39:20Z,user_data=None,user_id='1e71fb6475d84e689b2016c0872ef187',uuid=47cd9fde-110d-44c1-bae7-75885f66a199,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converting VIF {"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_vif [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap796876e4-b0, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing instance network info cache due to event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.network.neutron [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e05a15e6-4e99-4240-8c12-39ffa1fefe56) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:45 user nova-compute[74233]: INFO os_vif [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0')
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:40:45 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721cecf-fffb-43ef-b83b-54c8cbdc4477]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:40:45 user nova-compute[74233]: No targets found.
Oct 20 18:40:45 user nova-compute[74233]: iSNS:
Oct 20 18:40:45 user nova-compute[74233]: No targets found.
Oct 20 18:40:45 user nova-compute[74233]: STATIC:
Oct 20 18:40:45 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca
Oct 20 18:40:45 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:40:45 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:40:45 user nova-compute[74233]: FIRMWARE:
Oct 20 18:40:45 user nova-compute[74233]: No targets found.
Oct 20 18:40:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:40:45 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:40:45 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec52fa-36b6-4a97-a501-84af2223b90e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[32462441-882f-48fe-9444-5a22c14af003]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:40:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:40:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9704876d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a81993-48dc-4a84-913c-5a886eaf308e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7bfdc-7ec3-45be-9db4-dce1d00f7ffe]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a69ea5a-1c10-4d0f-aead-06e042b76f14]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[484211d9-efeb-438d-a02c-025b6117ceaf]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c6bf5-25c6-4198-aea1-f7878f5823a3]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.038s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba24b77b-139c-47b8-bc95-ee8d30e92896]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]
Oct 20 18:40:45 user nova-compute[74233]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.
Oct 20 18:40:45 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12474559-f066-463f-9309-569201f29efe]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] <== disconnect_volume: return (264ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:40:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Deleting instance files /opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199_del
Oct 20 18:40:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Deletion of /opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199_del complete
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-01ca3d85-182c-461e-aeff-085d8aaef970 req-23409755-7251-4f5a-ad7f-42fcd0751a5c service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-01ca3d85-182c-461e-aeff-085d8aaef970 req-23409755-7251-4f5a-ad7f-42fcd0751a5c service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-01ca3d85-182c-461e-aeff-085d8aaef970 req-23409755-7251-4f5a-ad7f-42fcd0751a5c service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-01ca3d85-182c-461e-aeff-085d8aaef970 req-23409755-7251-4f5a-ad7f-42fcd0751a5c service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-01ca3d85-182c-461e-aeff-085d8aaef970 req-23409755-7251-4f5a-ad7f-42fcd0751a5c service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:40:45 user nova-compute[74233]: WARNING nova.compute.manager [req-01ca3d85-182c-461e-aeff-085d8aaef970 req-23409755-7251-4f5a-ad7f-42fcd0751a5c service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state active and task_state shelving.
Oct 20 18:40:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG nova.network.neutron [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated VIF entry in instance network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG nova.network.neutron [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": null, "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap796876e4-b0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-78c74392-188f-4299-9d33-43e2c8a8a7bc req-c9c74ed5-7db8-49ae-b71b-cf414912c9c8 service nova] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:46 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Deleted allocations for instance 47cd9fde-110d-44c1-bae7-75885f66a199
Oct 20 18:40:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG nova.objects.instance [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'numa_topology' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG nova.objects.base [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Object Instance<47cd9fde-110d-44c1-bae7-75885f66a199> lazy-loaded attributes: resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:40:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.179s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:40:47 user nova-compute[74233]: INFO nova.compute.claims [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Claim successful on node user
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-fd6c06d0-b6c2-446a-97f5-f79e00dddf72 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.632s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:40:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.policy [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd2c1848a2c437082490de2207c58b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e472b626ad43d8b1422b554b64b1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:40:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Creating image(s)
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk 1073741824" returned: 0 in 0.048s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Successfully created port: 159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.185s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Cannot resize image /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Ensure instance console log exists: /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Successfully updated port: 159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing instance network info cache due to event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance network_info: |[{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Start _get_guest_xml network_info=[{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:40:48 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:40:48 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:40:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-854687284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-854687284',id=45,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmPyL+Rzj7kdjsGlS4weTsWObedXD76SdhpuKFACfDAIWpgzVRQBADxqPEGBT9GYzohIH1DcoTI3pzVf/OB/69Rlvc1kkK4RUr9B21hZIDQGi4Z0qR1ubiE6LbhBlSUYg==',key_name='tempest-keypair-1846309633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-e10gx0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f4052755-95e0-40d0-9f8c-3502d4b22d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'pci_devices' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:40:49 user nova-compute[74233]:   <uuid>f4052755-95e0-40d0-9f8c-3502d4b22d68</uuid>
Oct 20 18:40:49 user nova-compute[74233]:   <name>instance-0000002d</name>
Oct 20 18:40:49 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:40:49 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:40:49 user nova-compute[74233]:   <metadata>
Oct 20 18:40:49 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:40:49 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:40:49 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-854687284</nova:name>
Oct 20 18:40:49 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:40:48</nova:creationTime>
Oct 20 18:40:49 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:40:49 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:40:49 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:40:49 user nova-compute[74233]:       <nova:owner>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:user uuid="efd2c1848a2c437082490de2207c58b7">tempest-AttachVolumeShelveTestJSON-97665862-project-member</nova:user>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:project uuid="92e472b626ad43d8b1422b554b64b1a9">tempest-AttachVolumeShelveTestJSON-97665862</nova:project>
Oct 20 18:40:49 user nova-compute[74233]:       </nova:owner>
Oct 20 18:40:49 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:40:49 user nova-compute[74233]:       <nova:ports>
Oct 20 18:40:49 user nova-compute[74233]:         <nova:port uuid="159623b0-2132-4e68-a0da-a6daf31f0c8e">
Oct 20 18:40:49 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 18:40:49 user nova-compute[74233]:         </nova:port>
Oct 20 18:40:49 user nova-compute[74233]:       </nova:ports>
Oct 20 18:40:49 user nova-compute[74233]:     </nova:instance>
Oct 20 18:40:49 user nova-compute[74233]:   </metadata>
Oct 20 18:40:49 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:40:49 user nova-compute[74233]:     <system>
Oct 20 18:40:49 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:40:49 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:40:49 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:40:49 user nova-compute[74233]:       <entry name="serial">f4052755-95e0-40d0-9f8c-3502d4b22d68</entry>
Oct 20 18:40:49 user nova-compute[74233]:       <entry name="uuid">f4052755-95e0-40d0-9f8c-3502d4b22d68</entry>
Oct 20 18:40:49 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:40:49 user nova-compute[74233]:     </system>
Oct 20 18:40:49 user nova-compute[74233]:   </sysinfo>
Oct 20 18:40:49 user nova-compute[74233]:   <os>
Oct 20 18:40:49 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:40:49 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:40:49 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:40:49 user nova-compute[74233]:   </os>
Oct 20 18:40:49 user nova-compute[74233]:   <features>
Oct 20 18:40:49 user nova-compute[74233]:     <acpi/>
Oct 20 18:40:49 user nova-compute[74233]:     <apic/>
Oct 20 18:40:49 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:40:49 user nova-compute[74233]:   </features>
Oct 20 18:40:49 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:40:49 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:40:49 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:40:49 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:40:49 user nova-compute[74233]:   </clock>
Oct 20 18:40:49 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:40:49 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:40:49 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:40:49 user nova-compute[74233]:   </cpu>
Oct 20 18:40:49 user nova-compute[74233]:   <devices>
Oct 20 18:40:49 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:40:49 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:40:49 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk"/>
Oct 20 18:40:49 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:40:49 user nova-compute[74233]:     </disk>
Oct 20 18:40:49 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:40:49 user nova-compute[74233]:       <mac address="fa:16:3e:b0:5b:07"/>
Oct 20 18:40:49 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:40:49 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:40:49 user nova-compute[74233]:       <target dev="tap159623b0-21"/>
Oct 20 18:40:49 user nova-compute[74233]:     </interface>
Oct 20 18:40:49 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:40:49 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/console.log" append="off"/>
Oct 20 18:40:49 user nova-compute[74233]:     </serial>
Oct 20 18:40:49 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:40:49 user nova-compute[74233]:     <video>
Oct 20 18:40:49 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:40:49 user nova-compute[74233]:     </video>
Oct 20 18:40:49 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:40:49 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:40:49 user nova-compute[74233]:     </rng>
Oct 20 18:40:49 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:40:49 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:40:49 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:40:49 user nova-compute[74233]:     </memballoon>
Oct 20 18:40:49 user nova-compute[74233]:   </devices>
Oct 20 18:40:49 user nova-compute[74233]: </domain>
Oct 20 18:40:49 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-854687284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-854687284',id=45,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmPyL+Rzj7kdjsGlS4weTsWObedXD76SdhpuKFACfDAIWpgzVRQBADxqPEGBT9GYzohIH1DcoTI3pzVf/OB/69Rlvc1kkK4RUr9B21hZIDQGi4Z0qR1ubiE6LbhBlSUYg==',key_name='tempest-keypair-1846309633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-e10gx0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f4052755-95e0-40d0-9f8c-3502d4b22d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG os_vif [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89602e0f-ff8f-5c3a-a375-0f79770575e5', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap159623b0-21, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap159623b0-21, col_values=(('qos', UUID('93f91e3b-cc00-4054-bca7-d7165631098b')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap159623b0-21, col_values=(('external_ids', {'iface-id': '159623b0-2132-4e68-a0da-a6daf31f0c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5b:07', 'vm-uuid': 'f4052755-95e0-40d0-9f8c-3502d4b22d68'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:49 user nova-compute[74233]: INFO os_vif [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21')
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No VIF found with MAC fa:16:3e:b0:5b:07, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updated VIF entry in instance network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:40:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-432641f9-d8af-43ee-94c0-39280f71396c req-7054b3e7-772c-4a95-a9b8-c74cbf4022f9 service nova] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-9dc1315d-34fb-4273-b6ec-fdda20b4d253 req-595bd094-a0f2-4982-865d-078d94939f43 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9dc1315d-34fb-4273-b6ec-fdda20b4d253 req-595bd094-a0f2-4982-865d-078d94939f43 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9dc1315d-34fb-4273-b6ec-fdda20b4d253 req-595bd094-a0f2-4982-865d-078d94939f43 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9dc1315d-34fb-4273-b6ec-fdda20b4d253 req-595bd094-a0f2-4982-865d-078d94939f43 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-9dc1315d-34fb-4273-b6ec-fdda20b4d253 req-595bd094-a0f2-4982-865d-078d94939f43 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:40:50 user nova-compute[74233]: WARNING nova.compute.manager [req-9dc1315d-34fb-4273-b6ec-fdda20b4d253 req-595bd094-a0f2-4982-865d-078d94939f43 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state building and task_state spawning.
Oct 20 18:40:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:40:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance spawned successfully.
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:40:52 user nova-compute[74233]: INFO nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:40:52 user nova-compute[74233]: INFO nova.compute.manager [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Took 5.78 seconds to build instance.
Oct 20 18:40:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-03323fa6-b395-4810-b1e8-565e342d0a6f tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.865s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-3b33e366-a9ab-4b8b-80f2-8ce1ad21fdbe req-f99f8c4b-360e-45c6-bd43-ad53d8564139 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3b33e366-a9ab-4b8b-80f2-8ce1ad21fdbe req-f99f8c4b-360e-45c6-bd43-ad53d8564139 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3b33e366-a9ab-4b8b-80f2-8ce1ad21fdbe req-f99f8c4b-360e-45c6-bd43-ad53d8564139 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3b33e366-a9ab-4b8b-80f2-8ce1ad21fdbe req-f99f8c4b-360e-45c6-bd43-ad53d8564139 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:40:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-3b33e366-a9ab-4b8b-80f2-8ce1ad21fdbe req-f99f8c4b-360e-45c6-bd43-ad53d8564139 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:40:52 user nova-compute[74233]: WARNING nova.compute.manager [req-3b33e366-a9ab-4b8b-80f2-8ce1ad21fdbe req-f99f8c4b-360e-45c6-bd43-ad53d8564139 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state None.
Oct 20 18:40:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:40:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:41:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:41:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:41:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.097637176513672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f4052755-95e0-40d0-9f8c-3502d4b22d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:41:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:41:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:41:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:41:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:41:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:41:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:41:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:41:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:41:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:41:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:41:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Verify base images {{(pid=74233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Image id eaa6d842-3abb-4a80-92cd-b9a50e121c9f yields fingerprint 68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 {{(pid=74233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 18:41:43 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] image eaa6d842-3abb-4a80-92cd-b9a50e121c9f at (/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48): checking
Oct 20 18:41:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] image eaa6d842-3abb-4a80-92cd-b9a50e121c9f at (/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48): image is in use {{(pid=74233) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] f4052755-95e0-40d0-9f8c-3502d4b22d68 is a valid instance name {{(pid=74233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] f4052755-95e0-40d0-9f8c-3502d4b22d68 has a disk file {{(pid=74233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 18:41:43 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f4052755-95e0-40d0-9f8c-3502d4b22d68 is backed by 68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 {{(pid=74233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] f9602450-159a-4e44-81fe-966940c09ec1 is a valid instance name {{(pid=74233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] f9602450-159a-4e44-81fe-966940c09ec1 has a disk file {{(pid=74233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 is backed by 68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 {{(pid=74233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4
Oct 20 18:41:44 user nova-compute[74233]: WARNING nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Active base files: /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Removable base files: /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60 /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26 /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4 /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5e74349d9947366281ff94d4229905bb62f17fda
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c0536f94860f4c27480697b21f791dbab919bc60
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa9ca110b71d66870d63ff4e20177524008b5c7b
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbc0457a237cc8a1ac5ac1aed56b20d8facb25ae
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21bf7ba811382ef9b1c9a39f24a4e9cb0e0abe26
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50a5f9f5b2c5a3e5a007930d4523a7141d33c7d4
Oct 20 18:41:44 user nova-compute[74233]: INFO nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4aaec4f0ba6f64daf12f127eadbacc39d6646b2
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Verification complete {{(pid=74233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Verify swap images {{(pid=74233) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 18:41:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.imagecache [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Verify ephemeral images {{(pid=74233) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 18:41:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:41:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:41:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:41:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:41:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-changed-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Refreshing instance network info cache due to event network-changed-bc716143-0f5a-4fa8-86b2-41682e1932de. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] Acquiring lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] Acquired lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Refreshing network info cache for port bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updated VIF entry in instance network info cache for port bc716143-0f5a-4fa8-86b2-41682e1932de. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:41:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72453f77-b00b-4574-b564-40fec3eed133 req-2e1fff96-7776-4887-ac17-686c12c0f4f8 service nova] Releasing lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:41:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:41:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:41:59 user nova-compute[74233]: INFO nova.compute.manager [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Attaching volume f7f3c96d-43b7-4d69-99d8-38d36025313e to /dev/vdb
Oct 20 18:41:59 user nova-compute[74233]: DEBUG os_brick.utils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[101e88e8-e6f8-4f9a-b68c-eb924feb1029]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51abb2b-11e0-4e9c-b33f-8fef95f0f7b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea8ca7-6f64-44d4-a8cb-f21fc0485cf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0caf819-a95d-4d57-aa93-9d1a17e9626a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:41:59 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:41:59 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023a94d-d4d4-4d60-bb1e-adaa67fa8be5]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG os_brick.utils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:41:59 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating existing volume attachment record: f8001b2f-ba0a-40a5-97ab-bfee164aefdb {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:42:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:06 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:42:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:42:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:42:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:42:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFtyihJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:42:15 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:42:15 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:42:15 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80eb45e-ba80-40af-83fd-5f6efc8a6449]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:42:15 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9933eb-017c-49f3-af12-c87b4940cb29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e] added
Oct 20 18:42:15 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a0f7c2-a476-4ec7-8e83-1ee67ab66292]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648246a-b726-4538-a6bd-f2ae854d1438]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFtyihJw {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFtyihJw" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd17e9d2-c38d-4fd4-bc62-db8bdc71a53b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFtyihJw'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21415671-c92c-4e85-b776-f4d3966518be]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a6538-aec3-49bb-8c2f-4b4c0abc1996]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:42:15 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:42:15 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:42:15 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:42:15 user nova-compute[74233]: 
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2fe236-bec9-4141-91a6-1eb93b427523]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260]
Oct 20 18:42:15 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260] successful.
Oct 20 18:42:15 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a116e611-3c6d-4c3a-917c-3f53c4d14a8c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77898aac-e207-4490-a539-65c49d4b0b73]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:42:15 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:42:15 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[587845ce-5a28-4372-8c71-c97d95ac54df]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:15 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFtyihJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23962653233623338', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962653233623338', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:42:16 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:42:16 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:42:16 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:42:16 user nova-compute[74233]:   <serial>f7f3c96d-43b7-4d69-99d8-38d36025313e</serial>
Oct 20 18:42:16 user nova-compute[74233]: </disk>
Oct 20 18:42:16 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:83:89:a3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:42:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6fb30ea6-e783-4179-b197-618140b02910 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.628s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:18 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:18 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:42:18 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:42:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.096302032470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f4052755-95e0-40d0-9f8c-3502d4b22d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 304cff80-1f17-4d53-bd5d-63f6d549c84b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.284s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:42:20 user nova-compute[74233]: INFO nova.compute.claims [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Claim successful on node user
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:42:20 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:42:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.policy [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efaee4f6f36e458184f3aa737affdbc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a650cec6e38447d5a36decea9b4f4a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:42:21 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Creating image(s)
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "/opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.166s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk 1073741824" returned: 0 in 0.046s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Successfully created port: 35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Cannot resize image /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Ensure instance console log exists: /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Successfully updated port: 35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquired lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-changed-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.compute.manager [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Refreshing instance network info cache due to event network-changed-35c31202-6020-49bd-902f-ca7f5360ae90. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] Acquiring lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Updating instance_info_cache with network_info: [{"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Releasing lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Instance network_info: |[{"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] Acquired lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.neutron [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Refreshing network info cache for port 35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Start _get_guest_xml network_info=[{"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:42:22 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:42:22 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-651651258',display_name='tempest-AttachVolumeNegativeTest-server-651651258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-651651258',id=46,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9iGA3TF1MOS6dX3ZqAf9OwmFlXjC/msiWiRLs0wQwPokzztkhVj74vyPCfTzUlqF5C4Xyk1rfwYoQ991QC2Qoj9Oa1B1kT7kYZHI4wtWL8EKRe3ksQ0ehmYGa8nt432g==',key_name='tempest-keypair-1474061090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-mgxlveby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:42:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=304cff80-1f17-4d53-bd5d-63f6d549c84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'pci_devices' on Instance uuid 304cff80-1f17-4d53-bd5d-63f6d549c84b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:42:22 user nova-compute[74233]:   <uuid>304cff80-1f17-4d53-bd5d-63f6d549c84b</uuid>
Oct 20 18:42:22 user nova-compute[74233]:   <name>instance-0000002e</name>
Oct 20 18:42:22 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:42:22 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:42:22 user nova-compute[74233]:   <metadata>
Oct 20 18:42:22 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:42:22 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:42:22 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-651651258</nova:name>
Oct 20 18:42:22 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:42:22</nova:creationTime>
Oct 20 18:42:22 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:42:22 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:42:22 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:42:22 user nova-compute[74233]:       <nova:owner>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:user uuid="efaee4f6f36e458184f3aa737affdbc2">tempest-AttachVolumeNegativeTest-375409870-project-member</nova:user>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:project uuid="a650cec6e38447d5a36decea9b4f4a30">tempest-AttachVolumeNegativeTest-375409870</nova:project>
Oct 20 18:42:22 user nova-compute[74233]:       </nova:owner>
Oct 20 18:42:22 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:42:22 user nova-compute[74233]:       <nova:ports>
Oct 20 18:42:22 user nova-compute[74233]:         <nova:port uuid="35c31202-6020-49bd-902f-ca7f5360ae90">
Oct 20 18:42:22 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 18:42:22 user nova-compute[74233]:         </nova:port>
Oct 20 18:42:22 user nova-compute[74233]:       </nova:ports>
Oct 20 18:42:22 user nova-compute[74233]:     </nova:instance>
Oct 20 18:42:22 user nova-compute[74233]:   </metadata>
Oct 20 18:42:22 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:42:22 user nova-compute[74233]:     <system>
Oct 20 18:42:22 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:42:22 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:42:22 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:42:22 user nova-compute[74233]:       <entry name="serial">304cff80-1f17-4d53-bd5d-63f6d549c84b</entry>
Oct 20 18:42:22 user nova-compute[74233]:       <entry name="uuid">304cff80-1f17-4d53-bd5d-63f6d549c84b</entry>
Oct 20 18:42:22 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:42:22 user nova-compute[74233]:     </system>
Oct 20 18:42:22 user nova-compute[74233]:   </sysinfo>
Oct 20 18:42:22 user nova-compute[74233]:   <os>
Oct 20 18:42:22 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:42:22 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:42:22 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:42:22 user nova-compute[74233]:   </os>
Oct 20 18:42:22 user nova-compute[74233]:   <features>
Oct 20 18:42:22 user nova-compute[74233]:     <acpi/>
Oct 20 18:42:22 user nova-compute[74233]:     <apic/>
Oct 20 18:42:22 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:42:22 user nova-compute[74233]:   </features>
Oct 20 18:42:22 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:42:22 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:42:22 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:42:22 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:42:22 user nova-compute[74233]:   </clock>
Oct 20 18:42:22 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:42:22 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:42:22 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:42:22 user nova-compute[74233]:   </cpu>
Oct 20 18:42:22 user nova-compute[74233]:   <devices>
Oct 20 18:42:22 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:42:22 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:42:22 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk"/>
Oct 20 18:42:22 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:42:22 user nova-compute[74233]:     </disk>
Oct 20 18:42:22 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:42:22 user nova-compute[74233]:       <mac address="fa:16:3e:27:93:0c"/>
Oct 20 18:42:22 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:42:22 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:42:22 user nova-compute[74233]:       <target dev="tap35c31202-60"/>
Oct 20 18:42:22 user nova-compute[74233]:     </interface>
Oct 20 18:42:22 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:42:22 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/console.log" append="off"/>
Oct 20 18:42:22 user nova-compute[74233]:     </serial>
Oct 20 18:42:22 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:42:22 user nova-compute[74233]:     <video>
Oct 20 18:42:22 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:42:22 user nova-compute[74233]:     </video>
Oct 20 18:42:22 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:42:22 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:42:22 user nova-compute[74233]:     </rng>
Oct 20 18:42:22 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:42:22 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:42:22 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:42:22 user nova-compute[74233]:     </memballoon>
Oct 20 18:42:22 user nova-compute[74233]:   </devices>
Oct 20 18:42:22 user nova-compute[74233]: </domain>
Oct 20 18:42:22 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-651651258',display_name='tempest-AttachVolumeNegativeTest-server-651651258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-651651258',id=46,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9iGA3TF1MOS6dX3ZqAf9OwmFlXjC/msiWiRLs0wQwPokzztkhVj74vyPCfTzUlqF5C4Xyk1rfwYoQ991QC2Qoj9Oa1B1kT7kYZHI4wtWL8EKRe3ksQ0ehmYGa8nt432g==',key_name='tempest-keypair-1474061090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-mgxlveby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:42:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=304cff80-1f17-4d53-bd5d-63f6d549c84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG os_vif [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c83fcd11-3620-5528-829a-9dcb7318ad38', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35c31202-60, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35c31202-60, col_values=(('qos', UUID('2463aeab-a9a0-4688-a992-703ca2fc0bb1')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35c31202-60, col_values=(('external_ids', {'iface-id': '35c31202-6020-49bd-902f-ca7f5360ae90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:93:0c', 'vm-uuid': '304cff80-1f17-4d53-bd5d-63f6d549c84b'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:22 user nova-compute[74233]: INFO os_vif [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60')
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:42:22 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:27:93:0c, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:42:23 user nova-compute[74233]: DEBUG nova.network.neutron [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Updated VIF entry in instance network info cache for port 35c31202-6020-49bd-902f-ca7f5360ae90. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:42:23 user nova-compute[74233]: DEBUG nova.network.neutron [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Updating instance_info_cache with network_info: [{"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a438de35-1980-4a04-b8e2-914a8c856468 req-47b9fcd1-f58e-4591-ad9c-870e2375b9eb service nova] Releasing lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-056287ee-3827-4091-9e81-a01b9fe8c3d4 req-50daf29a-fd92-4f8a-bf89-754675efe142 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-056287ee-3827-4091-9e81-a01b9fe8c3d4 req-50daf29a-fd92-4f8a-bf89-754675efe142 service nova] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-056287ee-3827-4091-9e81-a01b9fe8c3d4 req-50daf29a-fd92-4f8a-bf89-754675efe142 service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-056287ee-3827-4091-9e81-a01b9fe8c3d4 req-50daf29a-fd92-4f8a-bf89-754675efe142 service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG nova.compute.manager [req-056287ee-3827-4091-9e81-a01b9fe8c3d4 req-50daf29a-fd92-4f8a-bf89-754675efe142 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] No waiting events found dispatching network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:24 user nova-compute[74233]: WARNING nova.compute.manager [req-056287ee-3827-4091-9e81-a01b9fe8c3d4 req-50daf29a-fd92-4f8a-bf89-754675efe142 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received unexpected event network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 for instance with vm_state building and task_state spawning.
Oct 20 18:42:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:42:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Instance spawned successfully.
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:42:26 user nova-compute[74233]: INFO nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-041f3913-cddd-4abd-8524-c4500754948e req-8ce810b7-9f4d-44a9-b17f-1911f8e3713a service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-041f3913-cddd-4abd-8524-c4500754948e req-8ce810b7-9f4d-44a9-b17f-1911f8e3713a service nova] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-041f3913-cddd-4abd-8524-c4500754948e req-8ce810b7-9f4d-44a9-b17f-1911f8e3713a service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-041f3913-cddd-4abd-8524-c4500754948e req-8ce810b7-9f4d-44a9-b17f-1911f8e3713a service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-041f3913-cddd-4abd-8524-c4500754948e req-8ce810b7-9f4d-44a9-b17f-1911f8e3713a service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] No waiting events found dispatching network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:26 user nova-compute[74233]: WARNING nova.compute.manager [req-041f3913-cddd-4abd-8524-c4500754948e req-8ce810b7-9f4d-44a9-b17f-1911f8e3713a service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received unexpected event network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 for instance with vm_state building and task_state spawning.
Oct 20 18:42:26 user nova-compute[74233]: INFO nova.compute.manager [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Took 6.47 seconds to build instance.
Oct 20 18:42:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6de6bcb2-23ab-4464-a863-26743b392b3c tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.612s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:42:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:42:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:42:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:42:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:34 user nova-compute[74233]: INFO nova.compute.manager [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Unshelving
Oct 20 18:42:34 user nova-compute[74233]: INFO nova.virt.block_device [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Booting with volume 39bfb05b-fbb3-4582-941e-6aeb44c884ca at /dev/vda
Oct 20 18:42:35 user nova-compute[74233]: DEBUG os_brick.utils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[64acc3ef-5973-4d86-9e9c-416f37eb0cb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2972644c-58d5-4d28-a580-b8497eda7c1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df91b1-11e3-4acb-872d-b6b3a18faea7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea0ded3-5f68-4981-b774-56d2a0933048]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:42:35 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:42:35 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d88b099-85eb-435b-bfed-193aab66592b]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG os_brick.utils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:42:35 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating existing volume attachment record: dad331e9-7603-485d-8f82-e90769873c6b {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing instance network info cache due to event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:42:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updated VIF entry in instance network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:42:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-be7870f4-c4c6-40be-9e12-6fca6d446701 req-28d20f0e-0cef-48c4-b77a-76ee7a787e69 service nova] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:40 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:42:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:42:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:43 user nova-compute[74233]: INFO nova.compute.manager [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Shelving
Oct 20 18:42:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-562ff65f-3a92-42f9-b522-50c668d1bcfb req-8afaa9dd-0cbc-4059-ad2c-230a58a06551 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-562ff65f-3a92-42f9-b522-50c668d1bcfb req-8afaa9dd-0cbc-4059-ad2c-230a58a06551 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-562ff65f-3a92-42f9-b522-50c668d1bcfb req-8afaa9dd-0cbc-4059-ad2c-230a58a06551 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-562ff65f-3a92-42f9-b522-50c668d1bcfb req-8afaa9dd-0cbc-4059-ad2c-230a58a06551 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-562ff65f-3a92-42f9-b522-50c668d1bcfb req-8afaa9dd-0cbc-4059-ad2c-230a58a06551 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:43 user nova-compute[74233]: WARNING nova.compute.manager [req-562ff65f-3a92-42f9-b522-50c668d1bcfb req-8afaa9dd-0cbc-4059-ad2c-230a58a06551 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state shelving.
Oct 20 18:42:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance destroyed successfully.
Oct 20 18:42:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Beginning cold snapshot process
Oct 20 18:42:44 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:42:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk /opt/stack/data/nova/instances/snapshots/tmpropuqnc7/edbf0ebff93346ae9a62ddfd1e075f66 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk /opt/stack/data/nova/instances/snapshots/tmpropuqnc7/edbf0ebff93346ae9a62ddfd1e075f66" returned: 0 in 0.478s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:45 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Snapshot extracted, beginning image upload
Oct 20 18:42:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:46 user nova-compute[74233]: WARNING nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:46 user nova-compute[74233]: WARNING nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:46 user nova-compute[74233]: WARNING nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:46 user nova-compute[74233]: WARNING nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:46 user nova-compute[74233]: WARNING nova.compute.manager [req-26cc21bb-a22a-4951-ab68-736f00c8f047 req-d2e24b6d-db70-4acc-9163-1f9e287b227e service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 18:42:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Snapshot image upload complete
Oct 20 18:42:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:42:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:47 user nova-compute[74233]: INFO nova.compute.manager [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Shelve offloading
Oct 20 18:42:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance destroyed successfully.
Oct 20 18:42:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:42:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance destroyed successfully.
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'resources' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-854687284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-854687284',id=45,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmPyL+Rzj7kdjsGlS4weTsWObedXD76SdhpuKFACfDAIWpgzVRQBADxqPEGBT9GYzohIH1DcoTI3pzVf/OB/69Rlvc1kkK4RUr9B21hZIDQGi4Z0qR1ubiE6LbhBlSUYg==',key_name='tempest-keypair-1846309633',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-e10gx0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member',shelved_at='2023-10-20T18:42:47.850125',shelved_host='user',shelved_image_id='2df9ec5d-832c-4798-89d5-e7ea3490b388'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f4052755-95e0-40d0-9f8c-3502d4b22d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG os_vif [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap159623b0-21, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93f91e3b-cc00-4054-bca7-d7165631098b) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:48 user nova-compute[74233]: INFO os_vif [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21')
Oct 20 18:42:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Deleting instance files /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68_del
Oct 20 18:42:48 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Deletion of /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68_del complete
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing instance network info cache due to event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:42:49 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Deleted allocations for instance f4052755-95e0-40d0-9f8c-3502d4b22d68
Oct 20 18:42:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'numa_topology' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG nova.objects.base [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f4052755-95e0-40d0-9f8c-3502d4b22d68> lazy-loaded attributes: resources,numa_topology {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b84-78ff-49cb-91dd-79f014f6957d tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.676s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updated VIF entry in instance network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG nova.network.neutron [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap159623b0-21", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-ce33239c-6b45-4bb5-8386-2deebccde3fd req-adb42f66-0496-4aab-b60f-0bca18c96136 service nova] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'pci_requests' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG nova.objects.instance [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'numa_topology' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:42:52 user nova-compute[74233]: INFO nova.compute.claims [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Claim successful on node user
Oct 20 18:42:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:42:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:53 user nova-compute[74233]: INFO nova.network.neutron [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating port 796876e4-b026-4c5c-8ac5-999b5d7774ad with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing instance network info cache due to event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:42:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Creating image(s)
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Did not create local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Ensure instance console log exists: /opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Start _get_guest_xml network_info=[{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'dad331e9-7603-485d-8f82-e90769873c6b', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47cd9fde-110d-44c1-bae7-75885f66a199', 'attached_at': '', 'detached_at': '', 'volume_id': '39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'serial': '39bfb05b-fbb3-4582-941e-6aeb44c884ca'}, 'volume_type': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.network.neutron [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:42:53 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:42:53 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.objects.instance [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:53 user nova-compute[74233]: DEBUG nova.objects.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Object Instance<47cd9fde-110d-44c1-bae7-75885f66a199> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:42:54 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:42:54 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:42:54 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef51135-0add-48b7-b7c6-18781081d7fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:42:54 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcb4d17-9b12-4d5f-be59-f6724b9a6f36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca] added
Oct 20 18:42:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6cf7da-597c-400c-87ec-835e843cae13]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a869497-e457-4414-8035-13d2fcd168ff]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PitsqvfF {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PitsqvfF" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceeb2a5-7ab8-4bbe-bee5-6b55f6fd02d5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PitsqvfF'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91630ef3-32af-498b-8103-563c92e953cb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c04e9-6936-451b-aad1-8726e51cf179]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:42:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:42:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ec2398-dd50-44de-bd0c-29bbe382d2f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]
Oct 20 18:42:54 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.
Oct 20 18:42:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6e00a-27f5-47e3-b260-444b7e73ce14]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c879940b-df49-4647-89a9-607c7a632333]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:42:54 user nova-compute[74233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:42:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:42:54 user nova-compute[74233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:42:54 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated VIF entry in instance network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a896860-ab30-46aa-9903-43f24970bd86]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:42:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e1968ca2-8c57-4fb7-8624-8163c39985ac req-02a1215e-b502-4b4a-9f35-dce7e65d3589 service nova] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23231336538366663', 'path': '/dev/sdc'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231336538366663', 'path': '/dev/sdc'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1821826801',display_name='tempest-TestShelveInstance-server-1821826801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1821826801',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1392667661',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e90e93b65ab04d76a80f107110c16459',ramdisk_id='',reservation_id='r-imi3gsbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1210267954',owner_user_name='tempest-TestShelveInstance-1210267954-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:42:35Z,user_data=None,user_id='1e71fb6475d84e689b2016c0872ef187',uuid=47cd9fde-110d-44c1-bae7-75885f66a199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converting VIF {"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'pci_devices' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.objects.base [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Object Instance<47cd9fde-110d-44c1-bae7-75885f66a199> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:42:55 user nova-compute[74233]:   <uuid>47cd9fde-110d-44c1-bae7-75885f66a199</uuid>
Oct 20 18:42:55 user nova-compute[74233]:   <name>instance-0000002b</name>
Oct 20 18:42:55 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:42:55 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:42:55 user nova-compute[74233]:   <metadata>
Oct 20 18:42:55 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:42:55 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:42:55 user nova-compute[74233]:       <nova:name>tempest-TestShelveInstance-server-1821826801</nova:name>
Oct 20 18:42:55 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:42:53</nova:creationTime>
Oct 20 18:42:55 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:42:55 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:42:55 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:42:55 user nova-compute[74233]:       <nova:owner>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:user uuid="1e71fb6475d84e689b2016c0872ef187">tempest-TestShelveInstance-1210267954-project-member</nova:user>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:project uuid="e90e93b65ab04d76a80f107110c16459">tempest-TestShelveInstance-1210267954</nova:project>
Oct 20 18:42:55 user nova-compute[74233]:       </nova:owner>
Oct 20 18:42:55 user nova-compute[74233]:       <nova:ports>
Oct 20 18:42:55 user nova-compute[74233]:         <nova:port uuid="796876e4-b026-4c5c-8ac5-999b5d7774ad">
Oct 20 18:42:55 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 18:42:55 user nova-compute[74233]:         </nova:port>
Oct 20 18:42:55 user nova-compute[74233]:       </nova:ports>
Oct 20 18:42:55 user nova-compute[74233]:     </nova:instance>
Oct 20 18:42:55 user nova-compute[74233]:   </metadata>
Oct 20 18:42:55 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:42:55 user nova-compute[74233]:     <system>
Oct 20 18:42:55 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:42:55 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:42:55 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:42:55 user nova-compute[74233]:       <entry name="serial">47cd9fde-110d-44c1-bae7-75885f66a199</entry>
Oct 20 18:42:55 user nova-compute[74233]:       <entry name="uuid">47cd9fde-110d-44c1-bae7-75885f66a199</entry>
Oct 20 18:42:55 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:42:55 user nova-compute[74233]:     </system>
Oct 20 18:42:55 user nova-compute[74233]:   </sysinfo>
Oct 20 18:42:55 user nova-compute[74233]:   <os>
Oct 20 18:42:55 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:42:55 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:42:55 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:42:55 user nova-compute[74233]:   </os>
Oct 20 18:42:55 user nova-compute[74233]:   <features>
Oct 20 18:42:55 user nova-compute[74233]:     <acpi/>
Oct 20 18:42:55 user nova-compute[74233]:     <apic/>
Oct 20 18:42:55 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:42:55 user nova-compute[74233]:   </features>
Oct 20 18:42:55 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:42:55 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:42:55 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:42:55 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:42:55 user nova-compute[74233]:   </clock>
Oct 20 18:42:55 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:42:55 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:42:55 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:42:55 user nova-compute[74233]:   </cpu>
Oct 20 18:42:55 user nova-compute[74233]:   <devices>
Oct 20 18:42:55 user nova-compute[74233]:     <disk type="block" device="disk">
Oct 20 18:42:55 user nova-compute[74233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:42:55 user nova-compute[74233]:       <source dev="/dev/sdc"/>
Oct 20 18:42:55 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:42:55 user nova-compute[74233]:       <serial>39bfb05b-fbb3-4582-941e-6aeb44c884ca</serial>
Oct 20 18:42:55 user nova-compute[74233]:     </disk>
Oct 20 18:42:55 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:42:55 user nova-compute[74233]:       <mac address="fa:16:3e:d7:57:6b"/>
Oct 20 18:42:55 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:42:55 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:42:55 user nova-compute[74233]:       <target dev="tap796876e4-b0"/>
Oct 20 18:42:55 user nova-compute[74233]:     </interface>
Oct 20 18:42:55 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:42:55 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199/console.log" append="off"/>
Oct 20 18:42:55 user nova-compute[74233]:     </serial>
Oct 20 18:42:55 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:42:55 user nova-compute[74233]:     <video>
Oct 20 18:42:55 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:42:55 user nova-compute[74233]:     </video>
Oct 20 18:42:55 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:42:55 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:42:55 user nova-compute[74233]:     </rng>
Oct 20 18:42:55 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:42:55 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:42:55 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:42:55 user nova-compute[74233]:     </memballoon>
Oct 20 18:42:55 user nova-compute[74233]:   </devices>
Oct 20 18:42:55 user nova-compute[74233]: </domain>
Oct 20 18:42:55 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1821826801',display_name='tempest-TestShelveInstance-server-1821826801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1821826801',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1392667661',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e90e93b65ab04d76a80f107110c16459',ramdisk_id='',reservation_id='r-imi3gsbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1210267954',owner_user_name='tempest-TestShelveInstance-1210267954-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:42:35Z,user_data=None,user_id='1e71fb6475d84e689b2016c0872ef187',uuid=47cd9fde-110d-44c1-bae7-75885f66a199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converting VIF {"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG os_vif [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55ee1af7-04a4-5b26-a8f5-0347dbe95f41', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap796876e4-b0, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap796876e4-b0, col_values=(('qos', UUID('da93ac5a-3610-4fd2-84da-b34dc829cf51')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap796876e4-b0, col_values=(('external_ids', {'iface-id': '796876e4-b026-4c5c-8ac5-999b5d7774ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:57:6b', 'vm-uuid': '47cd9fde-110d-44c1-bae7-75885f66a199'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:55 user nova-compute[74233]: INFO os_vif [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0')
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:42:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] No VIF found with MAC fa:16:3e:d7:57:6b, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-426da551-e3c1-4d3d-a2a0-4b6dc912dce3 req-1d7afdd2-6547-410e-8997-82575c47659f service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-426da551-e3c1-4d3d-a2a0-4b6dc912dce3 req-1d7afdd2-6547-410e-8997-82575c47659f service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-426da551-e3c1-4d3d-a2a0-4b6dc912dce3 req-1d7afdd2-6547-410e-8997-82575c47659f service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-426da551-e3c1-4d3d-a2a0-4b6dc912dce3 req-1d7afdd2-6547-410e-8997-82575c47659f service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-426da551-e3c1-4d3d-a2a0-4b6dc912dce3 req-1d7afdd2-6547-410e-8997-82575c47659f service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:56 user nova-compute[74233]: WARNING nova.compute.manager [req-426da551-e3c1-4d3d-a2a0-4b6dc912dce3 req-1d7afdd2-6547-410e-8997-82575c47659f service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 18:42:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:42:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:42:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:42:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance spawned successfully.
Oct 20 18:42:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:42:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-605fef77-be49-49cf-92f4-c13cbfd59041 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.930s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-576c9cb0-2e64-40c7-8bcf-4e8f370220e9 req-d6140f29-82b7-4f57-96c9-f95fe9672231 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576c9cb0-2e64-40c7-8bcf-4e8f370220e9 req-d6140f29-82b7-4f57-96c9-f95fe9672231 service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576c9cb0-2e64-40c7-8bcf-4e8f370220e9 req-d6140f29-82b7-4f57-96c9-f95fe9672231 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-576c9cb0-2e64-40c7-8bcf-4e8f370220e9 req-d6140f29-82b7-4f57-96c9-f95fe9672231 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG nova.compute.manager [req-576c9cb0-2e64-40c7-8bcf-4e8f370220e9 req-d6140f29-82b7-4f57-96c9-f95fe9672231 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:42:59 user nova-compute[74233]: WARNING nova.compute.manager [req-576c9cb0-2e64-40c7-8bcf-4e8f370220e9 req-d6140f29-82b7-4f57-96c9-f95fe9672231 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state active and task_state None.
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 304cff80-1f17-4d53-bd5d-63f6d549c84b {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "f9602450-159a-4e44-81fe-966940c09ec1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "f9602450-159a-4e44-81fe-966940c09ec1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:42:59 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:43:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:43:14 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:43:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:43:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:43:21 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:43:21 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.044445037841797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 304cff80-1f17-4d53-bd5d-63f6d549c84b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 47cd9fde-110d-44c1-bae7-75885f66a199 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:43:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:43:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:26 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:43:28 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:43:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:43:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:43:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:43:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:43:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:43:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:43:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:43:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:43:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-changed-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Refreshing instance network info cache due to event network-changed-35c31202-6020-49bd-902f-ca7f5360ae90. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] Acquiring lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] Acquired lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Refreshing network info cache for port 35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:11 user nova-compute[74233]: INFO nova.compute.manager [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Terminating instance
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Updated VIF entry in instance network info cache for port 35c31202-6020-49bd-902f-ca7f5360ae90. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.network.neutron [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Updating instance_info_cache with network_info: [{"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a3355af5-358b-43fe-ac64-342f67ab1b53 req-318298d3-5d01-44ff-bf8f-3c14060c61de service nova] Releasing lock "refresh_cache-304cff80-1f17-4d53-bd5d-63f6d549c84b" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-e2f1f401-0712-4c02-8475-4dc1754bbf56 req-c39a829f-0b76-4146-9080-5fc4b3b8b426 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-vif-unplugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e2f1f401-0712-4c02-8475-4dc1754bbf56 req-c39a829f-0b76-4146-9080-5fc4b3b8b426 service nova] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e2f1f401-0712-4c02-8475-4dc1754bbf56 req-c39a829f-0b76-4146-9080-5fc4b3b8b426 service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e2f1f401-0712-4c02-8475-4dc1754bbf56 req-c39a829f-0b76-4146-9080-5fc4b3b8b426 service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-e2f1f401-0712-4c02-8475-4dc1754bbf56 req-c39a829f-0b76-4146-9080-5fc4b3b8b426 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] No waiting events found dispatching network-vif-unplugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.compute.manager [req-e2f1f401-0712-4c02-8475-4dc1754bbf56 req-c39a829f-0b76-4146-9080-5fc4b3b8b426 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-vif-unplugged-35c31202-6020-49bd-902f-ca7f5360ae90 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Instance destroyed successfully.
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'resources' on Instance uuid 304cff80-1f17-4d53-bd5d-63f6d549c84b {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-651651258',display_name='tempest-AttachVolumeNegativeTest-server-651651258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-651651258',id=46,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9iGA3TF1MOS6dX3ZqAf9OwmFlXjC/msiWiRLs0wQwPokzztkhVj74vyPCfTzUlqF5C4Xyk1rfwYoQ991QC2Qoj9Oa1B1kT7kYZHI4wtWL8EKRe3ksQ0ehmYGa8nt432g==',key_name='tempest-keypair-1474061090',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-mgxlveby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=304cff80-1f17-4d53-bd5d-63f6d549c84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "35c31202-6020-49bd-902f-ca7f5360ae90", "address": "fa:16:3e:27:93:0c", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35c31202-60", "ovs_interfaceid": "35c31202-6020-49bd-902f-ca7f5360ae90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG os_vif [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35c31202-60, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2463aeab-a9a0-4688-a992-703ca2fc0bb1) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:12 user nova-compute[74233]: INFO os_vif [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:93:0c,bridge_name='br-int',has_traffic_filtering=True,id=35c31202-6020-49bd-902f-ca7f5360ae90,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35c31202-60')
Oct 20 18:44:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Deleting instance files /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b_del
Oct 20 18:44:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Deletion of /opt/stack/data/nova/instances/304cff80-1f17-4d53-bd5d-63f6d549c84b_del complete
Oct 20 18:44:12 user nova-compute[74233]: INFO nova.compute.manager [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 20 18:44:12 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:12 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Took 0.65 seconds to deallocate network for instance.
Oct 20 18:44:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:44:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:13 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Deleted allocations for instance 304cff80-1f17-4d53-bd5d-63f6d549c84b
Oct 20 18:44:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-b42dc2b0-c545-4ac4-9705-60f2b76f6119 req-5de48471-d8e0-427e-8c6b-31fd816e4b09 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-vif-deleted-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2b275c36-eaf9-459d-b84d-7d57523f3071 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.669s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-baf3112e-3a59-4db3-8543-db0d5243b694 req-f210cabe-37e7-4c7a-9512-30d3ea88afe2 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received event network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-baf3112e-3a59-4db3-8543-db0d5243b694 req-f210cabe-37e7-4c7a-9512-30d3ea88afe2 service nova] Acquiring lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-baf3112e-3a59-4db3-8543-db0d5243b694 req-f210cabe-37e7-4c7a-9512-30d3ea88afe2 service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-baf3112e-3a59-4db3-8543-db0d5243b694 req-f210cabe-37e7-4c7a-9512-30d3ea88afe2 service nova] Lock "304cff80-1f17-4d53-bd5d-63f6d549c84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG nova.compute.manager [req-baf3112e-3a59-4db3-8543-db0d5243b694 req-f210cabe-37e7-4c7a-9512-30d3ea88afe2 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] No waiting events found dispatching network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:44:13 user nova-compute[74233]: WARNING nova.compute.manager [req-baf3112e-3a59-4db3-8543-db0d5243b694 req-f210cabe-37e7-4c7a-9512-30d3ea88afe2 service nova] [instance: 304cff80-1f17-4d53-bd5d-63f6d549c84b] Received unexpected event network-vif-plugged-35c31202-6020-49bd-902f-ca7f5360ae90 for instance with vm_state deleted and task_state None.
Oct 20 18:44:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:44:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:44:19 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 18:44:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:44:20 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.071483612060547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 47cd9fde-110d-44c1-bae7-75885f66a199 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:44:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing instance network info cache due to event network-changed-796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Refreshing network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:26 user nova-compute[74233]: INFO nova.compute.manager [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Terminating instance
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-67b008e6-721c-4d20-a0a1-73b38c8056f0 req-12b22250-e032-46f2-9942-4ee0cd81ac36 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-unplugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-67b008e6-721c-4d20-a0a1-73b38c8056f0 req-12b22250-e032-46f2-9942-4ee0cd81ac36 service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-67b008e6-721c-4d20-a0a1-73b38c8056f0 req-12b22250-e032-46f2-9942-4ee0cd81ac36 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-67b008e6-721c-4d20-a0a1-73b38c8056f0 req-12b22250-e032-46f2-9942-4ee0cd81ac36 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-67b008e6-721c-4d20-a0a1-73b38c8056f0 req-12b22250-e032-46f2-9942-4ee0cd81ac36 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-unplugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-67b008e6-721c-4d20-a0a1-73b38c8056f0 req-12b22250-e032-46f2-9942-4ee0cd81ac36 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-unplugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated VIF entry in instance network info cache for port 796876e4-b026-4c5c-8ac5-999b5d7774ad. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [{"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-700fe85a-a291-403a-b26a-608a8feee739 req-003424e6-198f-4c96-aebb-7d4ebfba5fb1 service nova] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:44:26 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance destroyed successfully.
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lazy-loading 'resources' on Instance uuid 47cd9fde-110d-44c1-bae7-75885f66a199 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1821826801',display_name='tempest-TestShelveInstance-server-1821826801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1821826801',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqbuVnvRbghTfPyL8JSJuo8jPcxCFUF/HXHUr795ZoQaUSHPMV6dQduEGs6gQKY0DkTCeZdf2HwfgDho4LUzcfLu6PVrhxtUNf2OR9Oyqr/hOVopI20oPadvE3inV/+RA==',key_name='tempest-TestShelveInstance-1392667661',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e90e93b65ab04d76a80f107110c16459',ramdisk_id='',reservation_id='r-imi3gsbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1210267954',owner_user_name='tempest-TestShelveInstance-1210267954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:42:59Z,user_data=None,user_id='1e71fb6475d84e689b2016c0872ef187',uuid=47cd9fde-110d-44c1-bae7-75885f66a199,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converting VIF {"id": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "address": "fa:16:3e:d7:57:6b", "network": {"id": "d041f5c1-7851-4682-8de1-718b98d356d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-1387933325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e90e93b65ab04d76a80f107110c16459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796876e4-b0", "ovs_interfaceid": "796876e4-b026-4c5c-8ac5-999b5d7774ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_vif [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap796876e4-b0, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da93ac5a-3610-4fd2-84da-b34dc829cf51) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:26 user nova-compute[74233]: INFO os_vif [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:6b,bridge_name='br-int',has_traffic_filtering=True,id=796876e4-b026-4c5c-8ac5-999b5d7774ad,network=Network(d041f5c1-7851-4682-8de1-718b98d356d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796876e4-b0')
Oct 20 18:44:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PitsqvfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:44:26 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab9e48b-4b81-48ac-bade-d007c238c8fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:44:26 user nova-compute[74233]: No targets found.
Oct 20 18:44:26 user nova-compute[74233]: iSNS:
Oct 20 18:44:26 user nova-compute[74233]: No targets found.
Oct 20 18:44:26 user nova-compute[74233]: STATIC:
Oct 20 18:44:26 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca
Oct 20 18:44:26 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:44:26 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:44:26 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e
Oct 20 18:44:26 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:44:26 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:44:26 user nova-compute[74233]: FIRMWARE:
Oct 20 18:44:26 user nova-compute[74233]: No targets found.
Oct 20 18:44:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:44:26 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:44:26 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4a41bc-e8b9-405b-bea3-080aa42b0792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b0f26-2382-41a8-899c-658c9fd9b2ba]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:44:26 user nova-compute[74233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:44:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:44:26 user nova-compute[74233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca (non-flash)
Oct 20 18:44:26 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb95079c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca'): ({'sdc'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Removing single pathed devices sdc {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:44:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfe33e-41ce-4feb-b7c5-60df9c208f8c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b184f-5af2-46b4-aae1-e8f7c1ccfb39]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Flushing IO for device /dev/sdc {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79250b6-b5e7-43f7-87fa-0e40617c151f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dffb29-96ec-41ea-a632-a44f86f71a3d]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] SCSI volumes sdc have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9e75e78d', '/dev/disk/by-id/scsi-23231336538366663', '/dev/disk/by-id/scsi-1SCST_BIO9e75e78d-213e86fcbda184bf') {{(pid=85316) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b05833-4522-4a14-9526-0b589665ad97]: (4, None) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ef37a-5943-4231-905a-605d4221afb0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf968bc3-450c-403b-a972-3adcae36b57e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260]
Oct 20 18:44:27 user nova-compute[74233]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca, portal: 172.16.0.220,3260] successful.
Oct 20 18:44:27 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bfb05b-fbb3-4582-941e-6aeb44c884ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c3c60f-1f13-4a5f-b593-5d147e5f8307]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] <== disconnect_volume: return (286ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:44:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Deleting instance files /opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199_del
Oct 20 18:44:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Deletion of /opt/stack/data/nova/instances/47cd9fde-110d-44c1-bae7-75885f66a199_del complete
Oct 20 18:44:27 user nova-compute[74233]: INFO nova.compute.manager [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:44:27 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:27 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Took 0.41 seconds to deallocate network for instance.
Oct 20 18:44:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-e36e19b1-c0e6-41cc-8759-3af367ff4780 req-692bb75b-96e0-4956-a478-4dc559f438f1 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-deleted-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3507be3-bb20-42d1-a2b5-b914be799a9c req-8be0a352-5b71-47bf-801c-67751b4dd069 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3507be3-bb20-42d1-a2b5-b914be799a9c req-8be0a352-5b71-47bf-801c-67751b4dd069 service nova] Acquiring lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3507be3-bb20-42d1-a2b5-b914be799a9c req-8be0a352-5b71-47bf-801c-67751b4dd069 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e3507be3-bb20-42d1-a2b5-b914be799a9c req-8be0a352-5b71-47bf-801c-67751b4dd069 service nova] Lock "47cd9fde-110d-44c1-bae7-75885f66a199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-e3507be3-bb20-42d1-a2b5-b914be799a9c req-8be0a352-5b71-47bf-801c-67751b4dd069 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] No waiting events found dispatching network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:44:28 user nova-compute[74233]: WARNING nova.compute.manager [req-e3507be3-bb20-42d1-a2b5-b914be799a9c req-8be0a352-5b71-47bf-801c-67751b4dd069 service nova] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Received unexpected event network-vif-plugged-796876e4-b026-4c5c-8ac5-999b5d7774ad for instance with vm_state active and task_state deleting.
Oct 20 18:44:28 user nova-compute[74233]: INFO nova.compute.manager [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Took 0.77 seconds to detach 1 volumes for instance.
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Deleting volume: 39bfb05b-fbb3-4582-941e-6aeb44c884ca {{(pid=74233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:28 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Deleted allocations for instance 47cd9fde-110d-44c1-bae7-75885f66a199
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-2960e7c4-fe4b-443b-b21b-e8407b2abe90 tempest-TestShelveInstance-1210267954 tempest-TestShelveInstance-1210267954-project-member] Lock "47cd9fde-110d-44c1-bae7-75885f66a199" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.compute.utils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Can not refresh info_cache because instance was not found {{(pid=74233) refresh_info_cache_for_instance /opt/stack/nova/nova/compute/utils.py:1010}}
Oct 20 18:44:28 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:44:29 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-47cd9fde-110d-44c1-bae7-75885f66a199" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:44:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 47cd9fde-110d-44c1-bae7-75885f66a199] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:44:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:44:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:36 user nova-compute[74233]: INFO nova.compute.manager [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Unshelving
Oct 20 18:44:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'pci_requests' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'numa_topology' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:44:36 user nova-compute[74233]: INFO nova.compute.claims [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Claim successful on node user
Oct 20 18:44:36 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:36 user nova-compute[74233]: INFO nova.network.neutron [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating port 159623b0-2132-4e68-a0da-a6daf31f0c8e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:44:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing instance network info cache due to event network-changed-159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] Acquiring lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:44:37 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Creating image(s)
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] Acquired lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Refreshing network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG nova.objects.base [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f4052755-95e0-40d0-9f8c-3502d4b22d68> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "dca7d50050226af0f3e7489428ed07e2534f0c81" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "dca7d50050226af0f3e7489428ed07e2534f0c81" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:38 user nova-compute[74233]: DEBUG nova.virt.images [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] 2df9ec5d-832c-4798-89d5-e7ea3490b388 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:44:38 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:44:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.part /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updated VIF entry in instance network info cache for port 159623b0-2132-4e68-a0da-a6daf31f0c8e. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-d77c9ae3-787e-472d-8b7a-749433fff29a req-5032b519-9d1d-4bd1-928f-39453b12d57f service nova] Releasing lock "refresh_cache-f4052755-95e0-40d0-9f8c-3502d4b22d68" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.part /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.converted" returned: 0 in 0.265s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "dca7d50050226af0f3e7489428ed07e2534f0c81" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.727s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81 --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "dca7d50050226af0f3e7489428ed07e2534f0c81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "dca7d50050226af0f3e7489428ed07e2534f0c81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81 --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81,backing_fmt=raw /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81,backing_fmt=raw /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk 1073741824" returned: 0 in 0.049s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "dca7d50050226af0f3e7489428ed07e2534f0c81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dca7d50050226af0f3e7489428ed07e2534f0c81 --force-share --output=json" returned: 0 in 0.177s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'migration_context' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:39 user nova-compute[74233]: DEBUG nova.objects.base [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f4052755-95e0-40d0-9f8c-3502d4b22d68> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:44:39 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Rebasing disk image.
Oct 20 18:44:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:40 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 -F raw /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:44:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 -F raw /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk" returned: 0 in 2.170s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Ensure instance console log exists: /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Start _get_guest_xml network_info=[{"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5932e6ce64e64aef3defb9db125180cb',container_format='bare',created_at=2023-10-20T18:42:44Z,direct_url=<?>,disk_format='qcow2',id=2df9ec5d-832c-4798-89d5-e7ea3490b388,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-854687284-shelved',owner='92e472b626ad43d8b1422b554b64b1a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T18:42:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:44:42 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:44:42 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5932e6ce64e64aef3defb9db125180cb',container_format='bare',created_at=2023-10-20T18:42:44Z,direct_url=<?>,disk_format='qcow2',id=2df9ec5d-832c-4798-89d5-e7ea3490b388,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-854687284-shelved',owner='92e472b626ad43d8b1422b554b64b1a9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T18:42:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.objects.base [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f4052755-95e0-40d0-9f8c-3502d4b22d68> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-854687284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-854687284',id=45,image_ref='2df9ec5d-832c-4798-89d5-e7ea3490b388',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1846309633',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-e10gx0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member',shelved_at='2023-10-20T18:42:47.850125',shelved_host='user',shelved_image_id='2df9ec5d-832c-4798-89d5-e7ea3490b388'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f4052755-95e0-40d0-9f8c-3502d4b22d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'pci_devices' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.objects.base [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Object Instance<f4052755-95e0-40d0-9f8c-3502d4b22d68> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:44:42 user nova-compute[74233]:   <uuid>f4052755-95e0-40d0-9f8c-3502d4b22d68</uuid>
Oct 20 18:44:42 user nova-compute[74233]:   <name>instance-0000002d</name>
Oct 20 18:44:42 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:44:42 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:44:42 user nova-compute[74233]:   <metadata>
Oct 20 18:44:42 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:44:42 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:44:42 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-854687284</nova:name>
Oct 20 18:44:42 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:44:42</nova:creationTime>
Oct 20 18:44:42 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:44:42 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:44:42 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:44:42 user nova-compute[74233]:       <nova:owner>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:user uuid="efd2c1848a2c437082490de2207c58b7">tempest-AttachVolumeShelveTestJSON-97665862-project-member</nova:user>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:project uuid="92e472b626ad43d8b1422b554b64b1a9">tempest-AttachVolumeShelveTestJSON-97665862</nova:project>
Oct 20 18:44:42 user nova-compute[74233]:       </nova:owner>
Oct 20 18:44:42 user nova-compute[74233]:       <nova:root type="image" uuid="2df9ec5d-832c-4798-89d5-e7ea3490b388"/>
Oct 20 18:44:42 user nova-compute[74233]:       <nova:ports>
Oct 20 18:44:42 user nova-compute[74233]:         <nova:port uuid="159623b0-2132-4e68-a0da-a6daf31f0c8e">
Oct 20 18:44:42 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 18:44:42 user nova-compute[74233]:         </nova:port>
Oct 20 18:44:42 user nova-compute[74233]:       </nova:ports>
Oct 20 18:44:42 user nova-compute[74233]:     </nova:instance>
Oct 20 18:44:42 user nova-compute[74233]:   </metadata>
Oct 20 18:44:42 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:44:42 user nova-compute[74233]:     <system>
Oct 20 18:44:42 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:44:42 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:44:42 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:44:42 user nova-compute[74233]:       <entry name="serial">f4052755-95e0-40d0-9f8c-3502d4b22d68</entry>
Oct 20 18:44:42 user nova-compute[74233]:       <entry name="uuid">f4052755-95e0-40d0-9f8c-3502d4b22d68</entry>
Oct 20 18:44:42 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:44:42 user nova-compute[74233]:     </system>
Oct 20 18:44:42 user nova-compute[74233]:   </sysinfo>
Oct 20 18:44:42 user nova-compute[74233]:   <os>
Oct 20 18:44:42 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:44:42 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:44:42 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:44:42 user nova-compute[74233]:   </os>
Oct 20 18:44:42 user nova-compute[74233]:   <features>
Oct 20 18:44:42 user nova-compute[74233]:     <acpi/>
Oct 20 18:44:42 user nova-compute[74233]:     <apic/>
Oct 20 18:44:42 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:44:42 user nova-compute[74233]:   </features>
Oct 20 18:44:42 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:44:42 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:44:42 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:44:42 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:44:42 user nova-compute[74233]:   </clock>
Oct 20 18:44:42 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:44:42 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:44:42 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:44:42 user nova-compute[74233]:   </cpu>
Oct 20 18:44:42 user nova-compute[74233]:   <devices>
Oct 20 18:44:42 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:44:42 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:44:42 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk"/>
Oct 20 18:44:42 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:44:42 user nova-compute[74233]:     </disk>
Oct 20 18:44:42 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:44:42 user nova-compute[74233]:       <mac address="fa:16:3e:b0:5b:07"/>
Oct 20 18:44:42 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:44:42 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:44:42 user nova-compute[74233]:       <target dev="tap159623b0-21"/>
Oct 20 18:44:42 user nova-compute[74233]:     </interface>
Oct 20 18:44:42 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:44:42 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/console.log" append="off"/>
Oct 20 18:44:42 user nova-compute[74233]:     </serial>
Oct 20 18:44:42 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:44:42 user nova-compute[74233]:     <video>
Oct 20 18:44:42 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:44:42 user nova-compute[74233]:     </video>
Oct 20 18:44:42 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:44:42 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:44:42 user nova-compute[74233]:     </rng>
Oct 20 18:44:42 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:44:42 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:44:42 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:44:42 user nova-compute[74233]:     </memballoon>
Oct 20 18:44:42 user nova-compute[74233]:   </devices>
Oct 20 18:44:42 user nova-compute[74233]: </domain>
Oct 20 18:44:42 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-854687284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-854687284',id=45,image_ref='2df9ec5d-832c-4798-89d5-e7ea3490b388',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1846309633',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-e10gx0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member',shelved_at='2023-10-20T18:42:47.850125',shelved_host='user',shelved_image_id='2df9ec5d-832c-4798-89d5-e7ea3490b388'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f4052755-95e0-40d0-9f8c-3502d4b22d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG os_vif [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89602e0f-ff8f-5c3a-a375-0f79770575e5', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap159623b0-21, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap159623b0-21, col_values=(('qos', UUID('99abc2d4-c611-4c3c-8398-60776de6411e')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap159623b0-21, col_values=(('external_ids', {'iface-id': '159623b0-2132-4e68-a0da-a6daf31f0c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5b:07', 'vm-uuid': 'f4052755-95e0-40d0-9f8c-3502d4b22d68'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:42 user nova-compute[74233]: INFO os_vif [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21')
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:44:42 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] No VIF found with MAC fa:16:3e:b0:5b:07, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:44:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-844727ec-9eb0-4919-b80c-ab34ecb6f0b7 req-9c06ca6e-11aa-431d-a5d2-d2d1c1b2d197 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-844727ec-9eb0-4919-b80c-ab34ecb6f0b7 req-9c06ca6e-11aa-431d-a5d2-d2d1c1b2d197 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-844727ec-9eb0-4919-b80c-ab34ecb6f0b7 req-9c06ca6e-11aa-431d-a5d2-d2d1c1b2d197 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-844727ec-9eb0-4919-b80c-ab34ecb6f0b7 req-9c06ca6e-11aa-431d-a5d2-d2d1c1b2d197 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-844727ec-9eb0-4919-b80c-ab34ecb6f0b7 req-9c06ca6e-11aa-431d-a5d2-d2d1c1b2d197 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:44:44 user nova-compute[74233]: WARNING nova.compute.manager [req-844727ec-9eb0-4919-b80c-ab34ecb6f0b7 req-9c06ca6e-11aa-431d-a5d2-d2d1c1b2d197 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 18:44:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:44:46 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance spawned successfully.
Oct 20 18:44:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-86d8492e-13ef-4508-b784-c1dd4aaaa698 req-92142236-4ee5-4b61-bcf3-ad2e87e27492 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-86d8492e-13ef-4508-b784-c1dd4aaaa698 req-92142236-4ee5-4b61-bcf3-ad2e87e27492 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-86d8492e-13ef-4508-b784-c1dd4aaaa698 req-92142236-4ee5-4b61-bcf3-ad2e87e27492 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-86d8492e-13ef-4508-b784-c1dd4aaaa698 req-92142236-4ee5-4b61-bcf3-ad2e87e27492 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG nova.compute.manager [req-86d8492e-13ef-4508-b784-c1dd4aaaa698 req-92142236-4ee5-4b61-bcf3-ad2e87e27492 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:44:46 user nova-compute[74233]: WARNING nova.compute.manager [req-86d8492e-13ef-4508-b784-c1dd4aaaa698 req-92142236-4ee5-4b61-bcf3-ad2e87e27492 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 18:44:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:44:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c30501b2-94ce-4a9a-a620-784504b3ab45 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.273s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:44:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:44:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:02 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:02 user nova-compute[74233]: INFO nova.compute.manager [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Detaching volume f7f3c96d-43b7-4d69-99d8-38d36025313e
Oct 20 18:45:02 user nova-compute[74233]: INFO nova.virt.block_device [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Attempting to driver detach volume f7f3c96d-43b7-4d69-99d8-38d36025313e from mountpoint /dev/vdb
Oct 20 18:45:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Attempting to detach device vdb from instance f9602450-159a-4e44-81fe-966940c09ec1 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:45:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:45:02 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:45:02 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:45:02 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:45:02 user nova-compute[74233]:   <serial>f7f3c96d-43b7-4d69-99d8-38d36025313e</serial>
Oct 20 18:45:02 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:45:02 user nova-compute[74233]: </disk>
Oct 20 18:45:02 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:45:02 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully detached device vdb from instance f9602450-159a-4e44-81fe-966940c09ec1 from the persistent domain config.
Oct 20 18:45:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9602450-159a-4e44-81fe-966940c09ec1 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:45:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:45:02 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:45:02 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:45:02 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:45:02 user nova-compute[74233]:   <serial>f7f3c96d-43b7-4d69-99d8-38d36025313e</serial>
Oct 20 18:45:02 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:45:02 user nova-compute[74233]: </disk>
Oct 20 18:45:02 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:45:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:45:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:07 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:12 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:13 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:13 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:45:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:17 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:45:20 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:22 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:45:22 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.04454803466797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f9602450-159a-4e44-81fe-966940c09ec1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f4052755-95e0-40d0-9f8c-3502d4b22d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:22 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:23 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9602450-159a-4e44-81fe-966940c09ec1 is timed out.
Oct 20 18:45:23 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully detached device vdb from instance f9602450-159a-4e44-81fe-966940c09ec1 from the live domain config.
Oct 20 18:45:23 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFtyihJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:45:23 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dae579a-23ff-4085-9b45-4b6e7907a6d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:45:23 user nova-compute[74233]: No targets found.
Oct 20 18:45:23 user nova-compute[74233]: iSNS:
Oct 20 18:45:23 user nova-compute[74233]: No targets found.
Oct 20 18:45:23 user nova-compute[74233]: STATIC:
Oct 20 18:45:23 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e
Oct 20 18:45:23 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:45:23 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:45:23 user nova-compute[74233]: FIRMWARE:
Oct 20 18:45:23 user nova-compute[74233]: No targets found.
Oct 20 18:45:23 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:45:23 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:45:23 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8eccb0-0d65-4090-864d-bb3aa460126b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad335673-80e9-41fc-b204-22aae69bd6cb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:45:23 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e (non-flash)
Oct 20 18:45:23 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950672dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d2bd5-46c0-407f-a4c9-96cdc5d5d54e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[171a7508-85d8-4d04-bc52-a7d5cb80a3ea]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024d30f-254b-4824-81ac-827f9d2c1a4c]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8abd431-2bc3-417f-8fac-a649fb49a017]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9f7c8-7507-4789-b5c8-a0b7a754b5e4]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8311a4-9b47-4455-8a4c-0df5a976142e]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260]
Oct 20 18:45:23 user nova-compute[74233]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e, portal: 172.16.0.220,3260] successful.
Oct 20 18:45:23 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7f3c96d-43b7-4d69-99d8-38d36025313e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6dd0cf-c6bc-4a35-8929-ba180cbd06e5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== disconnect_volume: return (327ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:45:23 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:45:24 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:45:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6e29efb2-d94c-4816-bd5c-e232b23c37be tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:45:30 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:45:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:31 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [{"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:45:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f9602450-159a-4e44-81fe-966940c09ec1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:45:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:45:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:45:38 user nova-compute[74233]: INFO nova.compute.claims [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Claim successful on node user
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:45:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.policy [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a55ce39c0754618bee0c15cc7c62194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0543ec4d824458b55850006d926db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:45:38 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Creating image(s)
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "/opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "/opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "/opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:38 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.193s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk 1073741824" returned: 0 in 0.060s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Successfully created port: 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Cannot resize image /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Ensure instance console log exists: /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Successfully updated port: 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-changed-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Refreshing instance network info cache due to event network-changed-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Instance network_info: |[{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Refreshing network info cache for port 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Start _get_guest_xml network_info=[{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:45:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:45:40 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-671119680',display_name='tempest-TestStampPattern-server-671119680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-671119680',id=47,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWIEzEytNx+0iLAF9D9Qv3+Y3r8LsCO0PwIW8Ba0vdZ2VJMMmSuEA8Xu99yvdhZBUE1N8gxoPVcJJT8rE0rhk05C/y/8pli4AHOH9u2UNcRdFazrgnJROLfVddmOzPrqw==',key_name='tempest-TestStampPattern-1283546229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b0543ec4d824458b55850006d926db5',ramdisk_id='',reservation_id='r-5j7y04yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1502495783',owner_user_name='tempest-TestStampPattern-1502495783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:45:39Z,user_data=None,user_id='5a55ce39c0754618bee0c15cc7c62194',uuid=f98ef9b9-e0f6-453b-a80d-8094a4e7fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converting VIF {"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'pci_devices' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:45:40 user nova-compute[74233]:   <uuid>f98ef9b9-e0f6-453b-a80d-8094a4e7fabc</uuid>
Oct 20 18:45:40 user nova-compute[74233]:   <name>instance-0000002f</name>
Oct 20 18:45:40 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:45:40 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:45:40 user nova-compute[74233]:   <metadata>
Oct 20 18:45:40 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:45:40 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:45:40 user nova-compute[74233]:       <nova:name>tempest-TestStampPattern-server-671119680</nova:name>
Oct 20 18:45:40 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:45:40</nova:creationTime>
Oct 20 18:45:40 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:45:40 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:45:40 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:45:40 user nova-compute[74233]:       <nova:owner>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:user uuid="5a55ce39c0754618bee0c15cc7c62194">tempest-TestStampPattern-1502495783-project-member</nova:user>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:project uuid="9b0543ec4d824458b55850006d926db5">tempest-TestStampPattern-1502495783</nova:project>
Oct 20 18:45:40 user nova-compute[74233]:       </nova:owner>
Oct 20 18:45:40 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:45:40 user nova-compute[74233]:       <nova:ports>
Oct 20 18:45:40 user nova-compute[74233]:         <nova:port uuid="6c5bbc58-84b1-4fba-a41f-f466a6f4b3af">
Oct 20 18:45:40 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:45:40 user nova-compute[74233]:         </nova:port>
Oct 20 18:45:40 user nova-compute[74233]:       </nova:ports>
Oct 20 18:45:40 user nova-compute[74233]:     </nova:instance>
Oct 20 18:45:40 user nova-compute[74233]:   </metadata>
Oct 20 18:45:40 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:45:40 user nova-compute[74233]:     <system>
Oct 20 18:45:40 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:45:40 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:45:40 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:45:40 user nova-compute[74233]:       <entry name="serial">f98ef9b9-e0f6-453b-a80d-8094a4e7fabc</entry>
Oct 20 18:45:40 user nova-compute[74233]:       <entry name="uuid">f98ef9b9-e0f6-453b-a80d-8094a4e7fabc</entry>
Oct 20 18:45:40 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:45:40 user nova-compute[74233]:     </system>
Oct 20 18:45:40 user nova-compute[74233]:   </sysinfo>
Oct 20 18:45:40 user nova-compute[74233]:   <os>
Oct 20 18:45:40 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:45:40 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:45:40 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:45:40 user nova-compute[74233]:   </os>
Oct 20 18:45:40 user nova-compute[74233]:   <features>
Oct 20 18:45:40 user nova-compute[74233]:     <acpi/>
Oct 20 18:45:40 user nova-compute[74233]:     <apic/>
Oct 20 18:45:40 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:45:40 user nova-compute[74233]:   </features>
Oct 20 18:45:40 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:45:40 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:45:40 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:45:40 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:45:40 user nova-compute[74233]:   </clock>
Oct 20 18:45:40 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:45:40 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:45:40 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:45:40 user nova-compute[74233]:   </cpu>
Oct 20 18:45:40 user nova-compute[74233]:   <devices>
Oct 20 18:45:40 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:45:40 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:45:40 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk"/>
Oct 20 18:45:40 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:45:40 user nova-compute[74233]:     </disk>
Oct 20 18:45:40 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:45:40 user nova-compute[74233]:       <mac address="fa:16:3e:74:59:43"/>
Oct 20 18:45:40 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:45:40 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:45:40 user nova-compute[74233]:       <target dev="tap6c5bbc58-84"/>
Oct 20 18:45:40 user nova-compute[74233]:     </interface>
Oct 20 18:45:40 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:45:40 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/console.log" append="off"/>
Oct 20 18:45:40 user nova-compute[74233]:     </serial>
Oct 20 18:45:40 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:45:40 user nova-compute[74233]:     <video>
Oct 20 18:45:40 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:45:40 user nova-compute[74233]:     </video>
Oct 20 18:45:40 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:45:40 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:45:40 user nova-compute[74233]:     </rng>
Oct 20 18:45:40 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:45:40 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:45:40 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:45:40 user nova-compute[74233]:     </memballoon>
Oct 20 18:45:40 user nova-compute[74233]:   </devices>
Oct 20 18:45:40 user nova-compute[74233]: </domain>
Oct 20 18:45:40 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-671119680',display_name='tempest-TestStampPattern-server-671119680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-671119680',id=47,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWIEzEytNx+0iLAF9D9Qv3+Y3r8LsCO0PwIW8Ba0vdZ2VJMMmSuEA8Xu99yvdhZBUE1N8gxoPVcJJT8rE0rhk05C/y/8pli4AHOH9u2UNcRdFazrgnJROLfVddmOzPrqw==',key_name='tempest-TestStampPattern-1283546229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b0543ec4d824458b55850006d926db5',ramdisk_id='',reservation_id='r-5j7y04yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1502495783',owner_user_name='tempest-TestStampPattern-1502495783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:45:39Z,user_data=None,user_id='5a55ce39c0754618bee0c15cc7c62194',uuid=f98ef9b9-e0f6-453b-a80d-8094a4e7fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converting VIF {"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG os_vif [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08b5d7fa-7020-5d3d-a60b-1ce88e86b5c0', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c5bbc58-84, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c5bbc58-84, col_values=(('qos', UUID('9b43ab7e-75c5-4d7b-9f33-680c65010860')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c5bbc58-84, col_values=(('external_ids', {'iface-id': '6c5bbc58-84b1-4fba-a41f-f466a6f4b3af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:59:43', 'vm-uuid': 'f98ef9b9-e0f6-453b-a80d-8094a4e7fabc'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:40 user nova-compute[74233]: INFO os_vif [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84')
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No VIF found with MAC fa:16:3e:74:59:43, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updated VIF entry in instance network info cache for port 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:45:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-8ab67e04-0cbf-4759-8c41-f5a6fadb6c18 req-a80a75c2-94ee-4cc0-8d96-ff7dababb80f service nova] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:45:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-6f516821-999d-4ccb-930f-cf8104bc1751 req-293a2518-0592-4800-bb0d-4cf91b876fe6 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6f516821-999d-4ccb-930f-cf8104bc1751 req-293a2518-0592-4800-bb0d-4cf91b876fe6 service nova] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6f516821-999d-4ccb-930f-cf8104bc1751 req-293a2518-0592-4800-bb0d-4cf91b876fe6 service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6f516821-999d-4ccb-930f-cf8104bc1751 req-293a2518-0592-4800-bb0d-4cf91b876fe6 service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG nova.compute.manager [req-6f516821-999d-4ccb-930f-cf8104bc1751 req-293a2518-0592-4800-bb0d-4cf91b876fe6 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] No waiting events found dispatching network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:45:42 user nova-compute[74233]: WARNING nova.compute.manager [req-6f516821-999d-4ccb-930f-cf8104bc1751 req-293a2518-0592-4800-bb0d-4cf91b876fe6 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received unexpected event network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af for instance with vm_state building and task_state spawning.
Oct 20 18:45:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:45:44 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Instance spawned successfully.
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:45:44 user nova-compute[74233]: INFO nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:45:44 user nova-compute[74233]: INFO nova.compute.manager [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Took 5.86 seconds to build instance.
Oct 20 18:45:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bda63056-8e6e-441b-a153-b77a2548185f tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.025s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-3b39bf77-bfd3-42b9-bc8d-78cde3ba47b5 req-4541ccf2-1119-439a-9754-e25b7c8be5db service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3b39bf77-bfd3-42b9-bc8d-78cde3ba47b5 req-4541ccf2-1119-439a-9754-e25b7c8be5db service nova] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3b39bf77-bfd3-42b9-bc8d-78cde3ba47b5 req-4541ccf2-1119-439a-9754-e25b7c8be5db service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-3b39bf77-bfd3-42b9-bc8d-78cde3ba47b5 req-4541ccf2-1119-439a-9754-e25b7c8be5db service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-3b39bf77-bfd3-42b9-bc8d-78cde3ba47b5 req-4541ccf2-1119-439a-9754-e25b7c8be5db service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] No waiting events found dispatching network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:45:44 user nova-compute[74233]: WARNING nova.compute.manager [req-3b39bf77-bfd3-42b9-bc8d-78cde3ba47b5 req-4541ccf2-1119-439a-9754-e25b7c8be5db service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received unexpected event network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af for instance with vm_state active and task_state None.
Oct 20 18:45:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:53 user nova-compute[74233]: INFO nova.compute.manager [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Terminating instance
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-fb337a1e-2a96-4515-915f-6f27dec1c0ff req-73e86c91-9179-4b9c-afbe-3969f4129c07 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-vif-unplugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fb337a1e-2a96-4515-915f-6f27dec1c0ff req-73e86c91-9179-4b9c-afbe-3969f4129c07 service nova] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fb337a1e-2a96-4515-915f-6f27dec1c0ff req-73e86c91-9179-4b9c-afbe-3969f4129c07 service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fb337a1e-2a96-4515-915f-6f27dec1c0ff req-73e86c91-9179-4b9c-afbe-3969f4129c07 service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-fb337a1e-2a96-4515-915f-6f27dec1c0ff req-73e86c91-9179-4b9c-afbe-3969f4129c07 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] No waiting events found dispatching network-vif-unplugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.compute.manager [req-fb337a1e-2a96-4515-915f-6f27dec1c0ff req-73e86c91-9179-4b9c-afbe-3969f4129c07 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-vif-unplugged-bc716143-0f5a-4fa8-86b2-41682e1932de for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:45:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Instance destroyed successfully.
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.objects.instance [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'resources' on Instance uuid f9602450-159a-4e44-81fe-966940c09ec1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-166168778',display_name='tempest-AttachVolumeNegativeTest-server-166168778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-166168778',id=44,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIDZcUnJsTz719RWInyQoPd68YKlOE4Lib7c0ltc0gDw/4X0ubnM+jIm/mZcgck/yymmY5j10r7Dlnz/z1cYA0fQ/GXsVDPjZW3X/W1STKW8Kx26ygatCLt/5FkZFLBKw==',key_name='tempest-keypair-1915939227',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:40:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-phyvslj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=f9602450-159a-4e44-81fe-966940c09ec1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "bc716143-0f5a-4fa8-86b2-41682e1932de", "address": "fa:16:3e:83:89:a3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc716143-0f", "ovs_interfaceid": "bc716143-0f5a-4fa8-86b2-41682e1932de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG os_vif [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc716143-0f, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cce4c0a5-00e8-49ae-b105-2a8335eb5d9b) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:45:53 user nova-compute[74233]: INFO os_vif [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=bc716143-0f5a-4fa8-86b2-41682e1932de,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc716143-0f')
Oct 20 18:45:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Deleting instance files /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1_del
Oct 20 18:45:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Deletion of /opt/stack/data/nova/instances/f9602450-159a-4e44-81fe-966940c09ec1_del complete
Oct 20 18:45:53 user nova-compute[74233]: INFO nova.compute.manager [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 20 18:45:53 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:45:53 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f9602450-159a-4e44-81fe-966940c09ec1] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-917f1205-58d8-47be-8907-994a434a6053 req-46873da9-831e-4736-baab-3ae2654e3326 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-vif-deleted-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:45:54 user nova-compute[74233]: INFO nova.compute.manager [req-917f1205-58d8-47be-8907-994a434a6053 req-46873da9-831e-4736-baab-3ae2654e3326 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Neutron deleted interface bc716143-0f5a-4fa8-86b2-41682e1932de; detaching it from the instance and deleting it from the info cache
Oct 20 18:45:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-917f1205-58d8-47be-8907-994a434a6053 req-46873da9-831e-4736-baab-3ae2654e3326 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:45:54 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Took 0.65 seconds to deallocate network for instance.
Oct 20 18:45:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-917f1205-58d8-47be-8907-994a434a6053 req-46873da9-831e-4736-baab-3ae2654e3326 service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Detach interface failed, port_id=bc716143-0f5a-4fa8-86b2-41682e1932de, reason: Instance f9602450-159a-4e44-81fe-966940c09ec1 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:45:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:54 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Deleted allocations for instance f9602450-159a-4e44-81fe-966940c09ec1
Oct 20 18:45:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-37a3c9be-41dc-4c4f-a2d3-8b1a0f3ef9b9 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "f9602450-159a-4e44-81fe-966940c09ec1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-6fadc088-f1b1-4ced-9bda-61e9924b72cd req-cfb72107-9cfd-483b-889f-bc4d41cad3be service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received event network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:45:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6fadc088-f1b1-4ced-9bda-61e9924b72cd req-cfb72107-9cfd-483b-889f-bc4d41cad3be service nova] Acquiring lock "f9602450-159a-4e44-81fe-966940c09ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:45:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6fadc088-f1b1-4ced-9bda-61e9924b72cd req-cfb72107-9cfd-483b-889f-bc4d41cad3be service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:45:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-6fadc088-f1b1-4ced-9bda-61e9924b72cd req-cfb72107-9cfd-483b-889f-bc4d41cad3be service nova] Lock "f9602450-159a-4e44-81fe-966940c09ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:45:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-6fadc088-f1b1-4ced-9bda-61e9924b72cd req-cfb72107-9cfd-483b-889f-bc4d41cad3be service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] No waiting events found dispatching network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:45:55 user nova-compute[74233]: WARNING nova.compute.manager [req-6fadc088-f1b1-4ced-9bda-61e9924b72cd req-cfb72107-9cfd-483b-889f-bc4d41cad3be service nova] [instance: f9602450-159a-4e44-81fe-966940c09ec1] Received unexpected event network-vif-plugged-bc716143-0f5a-4fa8-86b2-41682e1932de for instance with vm_state deleted and task_state None.
Oct 20 18:45:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:46:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:21 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:21 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:46:21 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:23 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:46:23 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.033843994140625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f4052755-95e0-40d0-9f8c-3502d4b22d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:46:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:26 user nova-compute[74233]: INFO nova.compute.manager [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Terminating instance
Oct 20 18:46:26 user nova-compute[74233]: DEBUG nova.compute.manager [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-fdb30d9c-96c2-4f37-9c38-ef87e24b384a req-9f24b9ae-f05f-41ee-adc4-3a7fa5f61bf0 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fdb30d9c-96c2-4f37-9c38-ef87e24b384a req-9f24b9ae-f05f-41ee-adc4-3a7fa5f61bf0 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fdb30d9c-96c2-4f37-9c38-ef87e24b384a req-9f24b9ae-f05f-41ee-adc4-3a7fa5f61bf0 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fdb30d9c-96c2-4f37-9c38-ef87e24b384a req-9f24b9ae-f05f-41ee-adc4-3a7fa5f61bf0 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-fdb30d9c-96c2-4f37-9c38-ef87e24b384a req-9f24b9ae-f05f-41ee-adc4-3a7fa5f61bf0 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-fdb30d9c-96c2-4f37-9c38-ef87e24b384a req-9f24b9ae-f05f-41ee-adc4-3a7fa5f61bf0 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-unplugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:46:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Instance destroyed successfully.
Oct 20 18:46:27 user nova-compute[74233]: DEBUG nova.objects.instance [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lazy-loading 'resources' on Instance uuid f4052755-95e0-40d0-9f8c-3502d4b22d68 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T18:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-854687284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-854687284',id=45,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmPyL+Rzj7kdjsGlS4weTsWObedXD76SdhpuKFACfDAIWpgzVRQBADxqPEGBT9GYzohIH1DcoTI3pzVf/OB/69Rlvc1kkK4RUr9B21hZIDQGi4Z0qR1ubiE6LbhBlSUYg==',key_name='tempest-keypair-1846309633',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:44:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e472b626ad43d8b1422b554b64b1a9',ramdisk_id='',reservation_id='r-e10gx0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-97665862',owner_user_name='tempest-AttachVolumeShelveTestJSON-97665862-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:44:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd2c1848a2c437082490de2207c58b7',uuid=f4052755-95e0-40d0-9f8c-3502d4b22d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converting VIF {"id": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "address": "fa:16:3e:b0:5b:07", "network": {"id": "4ef61181-8f9f-4530-9ac1-0f89a650136c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-811828441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e472b626ad43d8b1422b554b64b1a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159623b0-21", "ovs_interfaceid": "159623b0-2132-4e68-a0da-a6daf31f0c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG os_vif [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap159623b0-21, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99abc2d4-c611-4c3c-8398-60776de6411e) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:46:27 user nova-compute[74233]: INFO os_vif [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:07,bridge_name='br-int',has_traffic_filtering=True,id=159623b0-2132-4e68-a0da-a6daf31f0c8e,network=Network(4ef61181-8f9f-4530-9ac1-0f89a650136c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159623b0-21')
Oct 20 18:46:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Deleting instance files /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68_del
Oct 20 18:46:27 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Deletion of /opt/stack/data/nova/instances/f4052755-95e0-40d0-9f8c-3502d4b22d68_del complete
Oct 20 18:46:27 user nova-compute[74233]: INFO nova.compute.manager [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 18:46:27 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:46:27 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:46:28 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Took 0.83 seconds to deallocate network for instance.
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-7d0fbb4a-36cb-43b1-82cd-a9bad2ff4228 req-152b166f-3c6b-46d2-8ef4-c84039bb1405 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-deleted-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:46:28 user nova-compute[74233]: INFO nova.compute.manager [req-7d0fbb4a-36cb-43b1-82cd-a9bad2ff4228 req-152b166f-3c6b-46d2-8ef4-c84039bb1405 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Neutron deleted interface 159623b0-2132-4e68-a0da-a6daf31f0c8e; detaching it from the instance and deleting it from the info cache
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.network.neutron [req-7d0fbb4a-36cb-43b1-82cd-a9bad2ff4228 req-152b166f-3c6b-46d2-8ef4-c84039bb1405 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-7d0fbb4a-36cb-43b1-82cd-a9bad2ff4228 req-152b166f-3c6b-46d2-8ef4-c84039bb1405 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Detach interface failed, port_id=159623b0-2132-4e68-a0da-a6daf31f0c8e, reason: Instance f4052755-95e0-40d0-9f8c-3502d4b22d68 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:28 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Deleted allocations for instance f4052755-95e0-40d0-9f8c-3502d4b22d68
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-010d09a5-8a28-4344-9914-03ff3825cae5 tempest-AttachVolumeShelveTestJSON-97665862 tempest-AttachVolumeShelveTestJSON-97665862-project-member] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.036s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-47cc3e35-02dc-440e-9923-d0a244a8cba4 req-446eed3e-2ea6-4fbc-bd33-c88fa995f739 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-47cc3e35-02dc-440e-9923-d0a244a8cba4 req-446eed3e-2ea6-4fbc-bd33-c88fa995f739 service nova] Acquiring lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-47cc3e35-02dc-440e-9923-d0a244a8cba4 req-446eed3e-2ea6-4fbc-bd33-c88fa995f739 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-47cc3e35-02dc-440e-9923-d0a244a8cba4 req-446eed3e-2ea6-4fbc-bd33-c88fa995f739 service nova] Lock "f4052755-95e0-40d0-9f8c-3502d4b22d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:28 user nova-compute[74233]: DEBUG nova.compute.manager [req-47cc3e35-02dc-440e-9923-d0a244a8cba4 req-446eed3e-2ea6-4fbc-bd33-c88fa995f739 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] No waiting events found dispatching network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:46:28 user nova-compute[74233]: WARNING nova.compute.manager [req-47cc3e35-02dc-440e-9923-d0a244a8cba4 req-446eed3e-2ea6-4fbc-bd33-c88fa995f739 service nova] [instance: f4052755-95e0-40d0-9f8c-3502d4b22d68] Received unexpected event network-vif-plugged-159623b0-2132-4e68-a0da-a6daf31f0c8e for instance with vm_state deleted and task_state None.
Oct 20 18:46:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:31 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:32 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:46:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:46:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:46:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:46:46 user nova-compute[74233]: INFO nova.compute.claims [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Claim successful on node user
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:46:46 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:46:46 user nova-compute[74233]: DEBUG nova.policy [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efaee4f6f36e458184f3aa737affdbc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a650cec6e38447d5a36decea9b4f4a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:46:47 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Creating image(s)
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk 1073741824" returned: 0 in 0.055s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Successfully created port: 3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Cannot resize image /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Ensure instance console log exists: /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:47 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Successfully updated port: 3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquired lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-changed-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.compute.manager [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Refreshing instance network info cache due to event network-changed-3880e123-660a-49de-a525-bd670027ceff. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] Acquiring lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updating instance_info_cache with network_info: [{"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Releasing lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Instance network_info: |[{"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] Acquired lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Refreshing network info cache for port 3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Start _get_guest_xml network_info=[{"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:46:48 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:46:48 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1005036057',display_name='tempest-AttachVolumeNegativeTest-server-1005036057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1005036057',id=48,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMPPu9Vr4eLILC/5CL1ebkXPY1UEeA+fMpXBd6DA+/RCXhWPEXznzTzcn2hcqhyVL60xCPv/FgWjl0aG8ae71+oWzZNTclhPo009phAbEWveeawQbjUcBOGe3jIxpI+2w==',key_name='tempest-keypair-2057378308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-9gj8fr2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=c7d85b1c-5983-491a-8af1-51ba6bf0e9bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'pci_devices' on Instance uuid c7d85b1c-5983-491a-8af1-51ba6bf0e9bb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:46:48 user nova-compute[74233]:   <uuid>c7d85b1c-5983-491a-8af1-51ba6bf0e9bb</uuid>
Oct 20 18:46:48 user nova-compute[74233]:   <name>instance-00000030</name>
Oct 20 18:46:48 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:46:48 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:46:48 user nova-compute[74233]:   <metadata>
Oct 20 18:46:48 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:46:48 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:46:48 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1005036057</nova:name>
Oct 20 18:46:48 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:46:48</nova:creationTime>
Oct 20 18:46:48 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:46:48 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:46:48 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:46:48 user nova-compute[74233]:       <nova:owner>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:user uuid="efaee4f6f36e458184f3aa737affdbc2">tempest-AttachVolumeNegativeTest-375409870-project-member</nova:user>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:project uuid="a650cec6e38447d5a36decea9b4f4a30">tempest-AttachVolumeNegativeTest-375409870</nova:project>
Oct 20 18:46:48 user nova-compute[74233]:       </nova:owner>
Oct 20 18:46:48 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:46:48 user nova-compute[74233]:       <nova:ports>
Oct 20 18:46:48 user nova-compute[74233]:         <nova:port uuid="3880e123-660a-49de-a525-bd670027ceff">
Oct 20 18:46:48 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 18:46:48 user nova-compute[74233]:         </nova:port>
Oct 20 18:46:48 user nova-compute[74233]:       </nova:ports>
Oct 20 18:46:48 user nova-compute[74233]:     </nova:instance>
Oct 20 18:46:48 user nova-compute[74233]:   </metadata>
Oct 20 18:46:48 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:46:48 user nova-compute[74233]:     <system>
Oct 20 18:46:48 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:46:48 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:46:48 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:46:48 user nova-compute[74233]:       <entry name="serial">c7d85b1c-5983-491a-8af1-51ba6bf0e9bb</entry>
Oct 20 18:46:48 user nova-compute[74233]:       <entry name="uuid">c7d85b1c-5983-491a-8af1-51ba6bf0e9bb</entry>
Oct 20 18:46:48 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:46:48 user nova-compute[74233]:     </system>
Oct 20 18:46:48 user nova-compute[74233]:   </sysinfo>
Oct 20 18:46:48 user nova-compute[74233]:   <os>
Oct 20 18:46:48 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:46:48 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:46:48 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:46:48 user nova-compute[74233]:   </os>
Oct 20 18:46:48 user nova-compute[74233]:   <features>
Oct 20 18:46:48 user nova-compute[74233]:     <acpi/>
Oct 20 18:46:48 user nova-compute[74233]:     <apic/>
Oct 20 18:46:48 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:46:48 user nova-compute[74233]:   </features>
Oct 20 18:46:48 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:46:48 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:46:48 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:46:48 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:46:48 user nova-compute[74233]:   </clock>
Oct 20 18:46:48 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:46:48 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:46:48 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:46:48 user nova-compute[74233]:   </cpu>
Oct 20 18:46:48 user nova-compute[74233]:   <devices>
Oct 20 18:46:48 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:46:48 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:46:48 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk"/>
Oct 20 18:46:48 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:46:48 user nova-compute[74233]:     </disk>
Oct 20 18:46:48 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:46:48 user nova-compute[74233]:       <mac address="fa:16:3e:3c:09:b3"/>
Oct 20 18:46:48 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:46:48 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:46:48 user nova-compute[74233]:       <target dev="tap3880e123-66"/>
Oct 20 18:46:48 user nova-compute[74233]:     </interface>
Oct 20 18:46:48 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:46:48 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/console.log" append="off"/>
Oct 20 18:46:48 user nova-compute[74233]:     </serial>
Oct 20 18:46:48 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:46:48 user nova-compute[74233]:     <video>
Oct 20 18:46:48 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:46:48 user nova-compute[74233]:     </video>
Oct 20 18:46:48 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:46:48 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:46:48 user nova-compute[74233]:     </rng>
Oct 20 18:46:48 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:46:48 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:46:48 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:46:48 user nova-compute[74233]:     </memballoon>
Oct 20 18:46:48 user nova-compute[74233]:   </devices>
Oct 20 18:46:48 user nova-compute[74233]: </domain>
Oct 20 18:46:48 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1005036057',display_name='tempest-AttachVolumeNegativeTest-server-1005036057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1005036057',id=48,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMPPu9Vr4eLILC/5CL1ebkXPY1UEeA+fMpXBd6DA+/RCXhWPEXznzTzcn2hcqhyVL60xCPv/FgWjl0aG8ae71+oWzZNTclhPo009phAbEWveeawQbjUcBOGe3jIxpI+2w==',key_name='tempest-keypair-2057378308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-9gj8fr2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=c7d85b1c-5983-491a-8af1-51ba6bf0e9bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG os_vif [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50dacca7-8725-5766-92bb-737786e15f43', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3880e123-66, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3880e123-66, col_values=(('qos', UUID('7a2eb5c8-7c0a-4d00-98d3-9536da6b8496')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3880e123-66, col_values=(('external_ids', {'iface-id': '3880e123-660a-49de-a525-bd670027ceff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:09:b3', 'vm-uuid': 'c7d85b1c-5983-491a-8af1-51ba6bf0e9bb'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:48 user nova-compute[74233]: INFO os_vif [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66')
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:3c:09:b3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updated VIF entry in instance network info cache for port 3880e123-660a-49de-a525-bd670027ceff. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG nova.network.neutron [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updating instance_info_cache with network_info: [{"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:46:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-0afa866d-d131-414d-9cc3-9ed892fde444 req-c9c07f3e-e6b6-4c29-b029-93ca227daff6 service nova] Releasing lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] No waiting events found dispatching network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:46:50 user nova-compute[74233]: WARNING nova.compute.manager [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received unexpected event network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff for instance with vm_state building and task_state spawning.
Oct 20 18:46:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] No waiting events found dispatching network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:46:50 user nova-compute[74233]: WARNING nova.compute.manager [req-74e4c176-c6ae-43b8-95c2-e12f51431641 req-f8bb603d-accb-45eb-92ce-fbf8d9dc5392 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received unexpected event network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff for instance with vm_state building and task_state spawning.
Oct 20 18:46:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:46:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Instance spawned successfully.
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:46:52 user nova-compute[74233]: INFO nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 20 18:46:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:46:52 user nova-compute[74233]: INFO nova.compute.manager [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Took 5.80 seconds to build instance.
Oct 20 18:46:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c72d5352-a1ae-4f78-8b12-5cc232b44dab tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.892s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:46:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:46:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:47:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:47:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:47:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:47:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:47:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:47:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:47:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:47:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:47:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:16 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:47:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:47:22 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:47:22 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:47:22 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:24 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:47:24 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8840MB free_disk=25.03183364868164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:47:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:47:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-changed-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG nova.compute.manager [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Refreshing instance network info cache due to event network-changed-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Refreshing network info cache for port 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updated VIF entry in instance network info cache for port 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG nova.network.neutron [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f2e59662-3d12-485e-ab82-46af44f40df5 req-1e10b27a-75f2-4d90-b1b6-e8376bf48b4e service nova] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'flavor' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:47:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:47:30 user nova-compute[74233]: INFO nova.compute.manager [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Attaching volume 61b0a470-6fa3-4652-b875-8817a9449771 to /dev/vdb
Oct 20 18:47:31 user nova-compute[74233]: DEBUG os_brick.utils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc0ba18-d745-49e5-96da-32ae37da2d71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab41d145-fcaa-4198-aca2-c9c646794438]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b751c7-6cd1-425a-8439-26e8f8da996a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c2333-aaf9-4494-96f7-075dc6d2d5a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:47:31 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08cad7-e573-49ab-8b1b-0e63aabd7d75]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG os_brick.utils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating existing volume attachment record: bf894426-80a6-4da4-8700-2774f8d85174 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:31 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:47:32 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:47:33 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:47:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:47:33 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:47:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:33 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZjPuqbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:47:47 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:47:47 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:47:47 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15075624-8a55-41f2-ad5c-0907ca0147d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:47:47 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73245bb6-ec78-41c8-a935-d5dd602e4965]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771] added
Oct 20 18:47:47 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[037cf3c5-dd29-44fe-8781-ea6e5c808bbb]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5c9c9-ef93-4fd4-b482-c8e871ff2809]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:47 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZjPuqbf {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZjPuqbf" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ce8dc9-cb34-4c74-85ac-e2f51b7c6fbd]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZjPuqbf'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b3cb9-5fc4-4f37-9ca5-d5b034a2dd07]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[de862033-279a-46be-aaa2-28034774374c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:47:48 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:47:48 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:47:48 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:47:48 user nova-compute[74233]: 
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf387c4-4851-4b8a-aff6-62bc5cfd6bf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260]
Oct 20 18:47:48 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260] successful.
Oct 20 18:47:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[18777fe1-bea3-4f20-9c08-c24c95fdb190]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bef2d3e-aa46-47f0-be6d-3d32955db927]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 (non-flash)
Oct 20 18:47:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 (non-flash)
Oct 20 18:47:48 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae232ade-1d23-4867-99ef-fc2c294ec0eb]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:47:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZjPuqbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26661613336343431', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661613336343431', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'flavor' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:47:49 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:47:49 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:47:49 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:47:49 user nova-compute[74233]:   <serial>61b0a470-6fa3-4652-b875-8817a9449771</serial>
Oct 20 18:47:49 user nova-compute[74233]: </disk>
Oct 20 18:47:49 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No VIF found with MAC fa:16:3e:74:59:43, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:47:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a04a1a08-2384-4df3-8149-66bbb8505a52 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.807s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:47:50 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:47:50 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:47:50 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:47:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:47:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:47:51 user nova-compute[74233]: INFO nova.compute.manager [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Detaching volume 61b0a470-6fa3-4652-b875-8817a9449771
Oct 20 18:47:51 user nova-compute[74233]: INFO nova.virt.block_device [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Attempting to driver detach volume 61b0a470-6fa3-4652-b875-8817a9449771 from mountpoint /dev/vdb
Oct 20 18:47:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Attempting to detach device vdb from instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:47:51 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:47:51 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:47:51 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:47:51 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:47:51 user nova-compute[74233]:   <serial>61b0a470-6fa3-4652-b875-8817a9449771</serial>
Oct 20 18:47:51 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:47:51 user nova-compute[74233]: </disk>
Oct 20 18:47:51 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:47:51 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully detached device vdb from instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc from the persistent domain config.
Oct 20 18:47:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:47:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:47:52 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:47:52 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:47:52 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:47:52 user nova-compute[74233]:   <serial>61b0a470-6fa3-4652-b875-8817a9449771</serial>
Oct 20 18:47:52 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:47:52 user nova-compute[74233]: </disk>
Oct 20 18:47:52 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:47:52 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:47:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:47:58 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:03 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:12 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc is timed out.
Oct 20 18:48:12 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully detached device vdb from instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc from the live domain config.
Oct 20 18:48:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZjPuqbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:48:12 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c20819c-dadd-4b16-9d58-68ea3bff1102]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:48:12 user nova-compute[74233]: No targets found.
Oct 20 18:48:12 user nova-compute[74233]: iSNS:
Oct 20 18:48:12 user nova-compute[74233]: No targets found.
Oct 20 18:48:12 user nova-compute[74233]: STATIC:
Oct 20 18:48:12 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771
Oct 20 18:48:12 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:48:12 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:48:12 user nova-compute[74233]: FIRMWARE:
Oct 20 18:48:12 user nova-compute[74233]: No targets found.
Oct 20 18:48:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:48:12 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:48:12 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98abd12c-79c7-4b83-80fc-519cbbd7cbd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3154240-449e-4d69-9125-4412e9f8787c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 (non-flash)
Oct 20 18:48:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 (non-flash)
Oct 20 18:48:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb950471c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf0266-3f16-4c53-9de0-d09625d4cf2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b697a6-5f18-4188-8c0c-f1eec8f70a8c]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75f1dd4-1054-4be0-9fc6-bb6fdd3e1ce7]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[069005ad-8cbe-400a-91c1-2c9c209d4b32]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba625e0b-12e0-4788-9c1b-057a9f912293]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b9695-ee71-422d-95bb-68e2ebbef23a]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260]
Oct 20 18:48:12 user nova-compute[74233]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771, portal: 172.16.0.220,3260] successful.
Oct 20 18:48:12 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0a470-6fa3-4652-b875-8817a9449771 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a1df2-c9b8-4e30-9fd1-be4fcd09d43e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] <== disconnect_volume: return (298ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:48:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:48:13 user nova-compute[74233]: DEBUG nova.objects.instance [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'flavor' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:48:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-73f68bc7-861d-4c43-bbbb-1292c1e506ef tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.662s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:13 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:48:15 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:48:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:48:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:48:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.028934478759766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:48:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:26 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:28 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:48:33 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:48:33 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:33 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:48:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:48:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:48:33 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:48:34 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updating instance_info_cache with network_info: [{"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:48:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:48:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:48:34 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:34 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:48:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-changed-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:48:37 user nova-compute[74233]: DEBUG nova.compute.manager [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Refreshing instance network info cache due to event network-changed-3880e123-660a-49de-a525-bd670027ceff. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:48:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] Acquiring lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:48:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] Acquired lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:48:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Refreshing network info cache for port 3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:48:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updated VIF entry in instance network info cache for port 3880e123-660a-49de-a525-bd670027ceff. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:48:38 user nova-compute[74233]: DEBUG nova.network.neutron [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updating instance_info_cache with network_info: [{"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:48:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-a160bfa0-1fbe-4234-a2c1-92659cc402b3 req-f7cb3314-3a1e-49e6-8f6c-056ddf8cdb33 service nova] Releasing lock "refresh_cache-c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:48:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid c7d85b1c-5983-491a-8af1-51ba6bf0e9bb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:42 user nova-compute[74233]: INFO nova.compute.manager [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Attaching volume 93ced1eb-7263-4c25-b1f3-7a97265fc5a9 to /dev/vdb
Oct 20 18:48:42 user nova-compute[74233]: DEBUG os_brick.utils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c8a089-ab2b-4756-9d63-5134c5fc74db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1783e8-c705-47b8-837b-d9085efafb8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85672ec-fee9-4ee5-9415-3f6088cf2081]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3abf1b2-c89e-4e22-aec2-17a7c3335b1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:48:42 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:48:42 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe7804f-43a6-4d35-91e8-52c4c50cae0f]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG os_brick.utils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:48:42 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updating existing volume attachment record: 13e551d4-35f0-4174-81a4-393bee7f8229 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:48:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:48:52 user nova-compute[74233]: INFO nova.compute.claims [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Claim successful on node user
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:48:52 user nova-compute[74233]: INFO nova.compute.manager [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] instance snapshotting
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:48:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Beginning live snapshot process
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:48:52 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:52 user nova-compute[74233]: DEBUG nova.policy [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f203dfc0b2454a2e8b2f5e4c77e9de16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b5963ae3b94c3a876cc013c8133fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:48:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Creating image(s)
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "/opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "/opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "/opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json -f qcow2 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.199s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp4s4knlr/0240d2f611c644288d1d7838c906b6c7.delta 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Successfully created port: e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk 1073741824" returned: 0 in 0.092s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp4s4knlr/0240d2f611c644288d1d7838c906b6c7.delta 1073741824" returned: 0 in 0.087s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Cannot resize image /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Ensure instance console log exists: /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Successfully updated port: e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquired lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-changed-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Refreshing instance network info cache due to event network-changed-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] Acquiring lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updating instance_info_cache with network_info: [{"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Releasing lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Instance network_info: |[{"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] Acquired lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Refreshing network info cache for port e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Start _get_guest_xml network_info=[{"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:48:54 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:48:54 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-459281734',display_name='tempest-VolumesActionsTest-instance-459281734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-459281734',id=49,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b5963ae3b94c3a876cc013c8133fe8',ramdisk_id='',reservation_id='r-cnnes0s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1731323280',owner_user_name='tempest-VolumesActionsTest-1731323280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:48:53Z,user_data=None,user_id='f203dfc0b2454a2e8b2f5e4c77e9de16',uuid=1004cdbb-4365-4e3a-bfab-75f39406d6d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converting VIF {"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.objects.instance [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lazy-loading 'pci_devices' on Instance uuid 1004cdbb-4365-4e3a-bfab-75f39406d6d1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:48:54 user nova-compute[74233]:   <uuid>1004cdbb-4365-4e3a-bfab-75f39406d6d1</uuid>
Oct 20 18:48:54 user nova-compute[74233]:   <name>instance-00000031</name>
Oct 20 18:48:54 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:48:54 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:48:54 user nova-compute[74233]:   <metadata>
Oct 20 18:48:54 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:48:54 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:48:54 user nova-compute[74233]:       <nova:name>tempest-VolumesActionsTest-instance-459281734</nova:name>
Oct 20 18:48:54 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:48:54</nova:creationTime>
Oct 20 18:48:54 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:48:54 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:48:54 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:48:54 user nova-compute[74233]:       <nova:owner>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:user uuid="f203dfc0b2454a2e8b2f5e4c77e9de16">tempest-VolumesActionsTest-1731323280-project-member</nova:user>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:project uuid="31b5963ae3b94c3a876cc013c8133fe8">tempest-VolumesActionsTest-1731323280</nova:project>
Oct 20 18:48:54 user nova-compute[74233]:       </nova:owner>
Oct 20 18:48:54 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:48:54 user nova-compute[74233]:       <nova:ports>
Oct 20 18:48:54 user nova-compute[74233]:         <nova:port uuid="e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1">
Oct 20 18:48:54 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 18:48:54 user nova-compute[74233]:         </nova:port>
Oct 20 18:48:54 user nova-compute[74233]:       </nova:ports>
Oct 20 18:48:54 user nova-compute[74233]:     </nova:instance>
Oct 20 18:48:54 user nova-compute[74233]:   </metadata>
Oct 20 18:48:54 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:48:54 user nova-compute[74233]:     <system>
Oct 20 18:48:54 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:48:54 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:48:54 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:48:54 user nova-compute[74233]:       <entry name="serial">1004cdbb-4365-4e3a-bfab-75f39406d6d1</entry>
Oct 20 18:48:54 user nova-compute[74233]:       <entry name="uuid">1004cdbb-4365-4e3a-bfab-75f39406d6d1</entry>
Oct 20 18:48:54 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:48:54 user nova-compute[74233]:     </system>
Oct 20 18:48:54 user nova-compute[74233]:   </sysinfo>
Oct 20 18:48:54 user nova-compute[74233]:   <os>
Oct 20 18:48:54 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:48:54 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:48:54 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:48:54 user nova-compute[74233]:   </os>
Oct 20 18:48:54 user nova-compute[74233]:   <features>
Oct 20 18:48:54 user nova-compute[74233]:     <acpi/>
Oct 20 18:48:54 user nova-compute[74233]:     <apic/>
Oct 20 18:48:54 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:48:54 user nova-compute[74233]:   </features>
Oct 20 18:48:54 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:48:54 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:48:54 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:48:54 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:48:54 user nova-compute[74233]:   </clock>
Oct 20 18:48:54 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:48:54 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:48:54 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:48:54 user nova-compute[74233]:   </cpu>
Oct 20 18:48:54 user nova-compute[74233]:   <devices>
Oct 20 18:48:54 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:48:54 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:48:54 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk"/>
Oct 20 18:48:54 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:48:54 user nova-compute[74233]:     </disk>
Oct 20 18:48:54 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:48:54 user nova-compute[74233]:       <mac address="fa:16:3e:10:be:b3"/>
Oct 20 18:48:54 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:48:54 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:48:54 user nova-compute[74233]:       <target dev="tape44d3ca1-8d"/>
Oct 20 18:48:54 user nova-compute[74233]:     </interface>
Oct 20 18:48:54 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:48:54 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/console.log" append="off"/>
Oct 20 18:48:54 user nova-compute[74233]:     </serial>
Oct 20 18:48:54 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:48:54 user nova-compute[74233]:     <video>
Oct 20 18:48:54 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:48:54 user nova-compute[74233]:     </video>
Oct 20 18:48:54 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:48:54 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:48:54 user nova-compute[74233]:     </rng>
Oct 20 18:48:54 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:48:54 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:48:54 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:48:54 user nova-compute[74233]:     </memballoon>
Oct 20 18:48:54 user nova-compute[74233]:   </devices>
Oct 20 18:48:54 user nova-compute[74233]: </domain>
Oct 20 18:48:54 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-459281734',display_name='tempest-VolumesActionsTest-instance-459281734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-459281734',id=49,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b5963ae3b94c3a876cc013c8133fe8',ramdisk_id='',reservation_id='r-cnnes0s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1731323280',owner_user_name='tempest-VolumesActionsTest-1731323280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:48:53Z,user_data=None,user_id='f203dfc0b2454a2e8b2f5e4c77e9de16',uuid=1004cdbb-4365-4e3a-bfab-75f39406d6d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converting VIF {"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG os_vif [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7292da3b-051c-5277-9fb5-36104e56e463', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape44d3ca1-8d, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape44d3ca1-8d, col_values=(('qos', UUID('a7dc2bd7-06b2-4071-8aed-6b0c2796ede8')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape44d3ca1-8d, col_values=(('external_ids', {'iface-id': 'e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:be:b3', 'vm-uuid': '1004cdbb-4365-4e3a-bfab-75f39406d6d1'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:54 user nova-compute[74233]: INFO os_vif [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d')
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] No VIF found with MAC fa:16:3e:10:be:b3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 18:48:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updated VIF entry in instance network info cache for port e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updating instance_info_cache with network_info: [{"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-87b0eab2-c79b-4bfc-b9c3-83238939a2f3 req-f2a02203-cdd6-406e-b474-9dcc64777cc3 service nova] Releasing lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:48:54 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp4s4knlr/0240d2f611c644288d1d7838c906b6c7.delta /opt/stack/data/nova/instances/snapshots/tmpp4s4knlr/0240d2f611c644288d1d7838c906b6c7 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:48:55 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp4s4knlr/0240d2f611c644288d1d7838c906b6c7.delta /opt/stack/data/nova/instances/snapshots/tmpp4s4knlr/0240d2f611c644288d1d7838c906b6c7" returned: 0 in 0.464s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:48:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Snapshot extracted, beginning image upload
Oct 20 18:48:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-bdd58512-564b-4626-b4c9-c9a0414ce5e6 req-2a26c392-ba53-46ee-b380-c33ef4a117b8 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bdd58512-564b-4626-b4c9-c9a0414ce5e6 req-2a26c392-ba53-46ee-b380-c33ef4a117b8 service nova] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bdd58512-564b-4626-b4c9-c9a0414ce5e6 req-2a26c392-ba53-46ee-b380-c33ef4a117b8 service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-bdd58512-564b-4626-b4c9-c9a0414ce5e6 req-2a26c392-ba53-46ee-b380-c33ef4a117b8 service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG nova.compute.manager [req-bdd58512-564b-4626-b4c9-c9a0414ce5e6 req-2a26c392-ba53-46ee-b380-c33ef4a117b8 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] No waiting events found dispatching network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:48:56 user nova-compute[74233]: WARNING nova.compute.manager [req-bdd58512-564b-4626-b4c9-c9a0414ce5e6 req-2a26c392-ba53-46ee-b380-c33ef4a117b8 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received unexpected event network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 for instance with vm_state building and task_state spawning.
Oct 20 18:48:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:48:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Instance spawned successfully.
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:48:58 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Snapshot image upload complete
Oct 20 18:48:58 user nova-compute[74233]: INFO nova.compute.manager [None req-9209a2e0-dc66-414e-8fe1-c0e09c531994 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Took 5.55 seconds to snapshot the instance on the hypervisor.
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-72fcaf85-a24d-481c-9970-379d8d292036 req-2427acbf-0f8e-41a6-9fde-fa7b30104430 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72fcaf85-a24d-481c-9970-379d8d292036 req-2427acbf-0f8e-41a6-9fde-fa7b30104430 service nova] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72fcaf85-a24d-481c-9970-379d8d292036 req-2427acbf-0f8e-41a6-9fde-fa7b30104430 service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-72fcaf85-a24d-481c-9970-379d8d292036 req-2427acbf-0f8e-41a6-9fde-fa7b30104430 service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.compute.manager [req-72fcaf85-a24d-481c-9970-379d8d292036 req-2427acbf-0f8e-41a6-9fde-fa7b30104430 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] No waiting events found dispatching network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:48:58 user nova-compute[74233]: WARNING nova.compute.manager [req-72fcaf85-a24d-481c-9970-379d8d292036 req-2427acbf-0f8e-41a6-9fde-fa7b30104430 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received unexpected event network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 for instance with vm_state building and task_state spawning.
Oct 20 18:48:58 user nova-compute[74233]: INFO nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Took 5.24 seconds to spawn the instance on the hypervisor.
Oct 20 18:48:58 user nova-compute[74233]: DEBUG nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:48:58 user nova-compute[74233]: INFO nova.compute.manager [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Took 5.91 seconds to build instance.
Oct 20 18:48:58 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-c2e5f185-c267-4df5-886c-01402afce636 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:48:59 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmoWOUid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:49:00 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:49:00 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:49:00 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e8cdd-30ed-4166-9f10-492306c9653e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:49:00 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[223d94c1-f05d-4eb2-a1e0-6bfa305be0db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9] added
Oct 20 18:49:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46c2ec-19fe-4a84-8050-ce2cd719d58a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ea8ff-9f5c-4e1b-b26b-c3aec4dd4089]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmoWOUid {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmoWOUid" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479175a-976c-4b45-bf8a-82fa92520eab]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YmoWOUid'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0438f2-9c43-4834-8a0c-3405dec99cb1]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4e24fc-896d-4050-ab6d-b4351ae2a27a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:49:00 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:49:00 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:49:00 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:49:00 user nova-compute[74233]: 
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6c93a-596e-4420-9a99-1aa0c273b096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260]
Oct 20 18:49:00 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260] successful.
Oct 20 18:49:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7327561-2285-4b2a-906f-eebbb4bb678e]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee8992c-5655-483c-93d1-d372cbdb7f0a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 (non-flash)
Oct 20 18:49:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 (non-flash)
Oct 20 18:49:00 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c82ab58-2da3-470d-8ed5-0e07db713562]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmoWOUid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:49:00 user nova-compute[74233]: INFO nova.compute.claims [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Claim successful on node user
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:49:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.policy [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a55ce39c0754618bee0c15cc7c62194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0543ec4d824458b55850006d926db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:49:00 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Creating image(s)
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "/opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "/opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "/opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "818b0bc0851b4374150d074ee90806e255c07835" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:00 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "818b0bc0851b4374150d074ee90806e255c07835" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.968s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== connect_volume: return (1972ms) {'type': 'block', 'scsi_wwn': '26632643564636263', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632643564636263', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Successfully created port: 92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.part --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG nova.objects.instance [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid c7d85b1c-5983-491a-8af1-51ba6bf0e9bb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:49:02 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:49:02 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:49:02 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:49:02 user nova-compute[74233]:   <serial>93ced1eb-7263-4c25-b1f3-7a97265fc5a9</serial>
Oct 20 18:49:02 user nova-compute[74233]: </disk>
Oct 20 18:49:02 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG nova.virt.images [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ced7ad6c-0592-4839-ace8-c03da9473658 was qcow2, converting to raw {{(pid=74233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG nova.privsep.utils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 18:49:02 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.part /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.converted {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.part /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.converted" returned: 0 in 0.382s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.converted --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:3c:09:b3, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Successfully updated port: 92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquired lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "818b0bc0851b4374150d074ee90806e255c07835" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.317s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-changed-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.compute.manager [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Refreshing instance network info cache due to event network-changed-92ed642f-afa3-4264-9960-59a7bf139293. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] Acquiring lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-4640782d-e0b1-44c3-9890-eb676029aed6 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.649s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835 --force-share --output=json" returned: 0 in 0.187s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "818b0bc0851b4374150d074ee90806e255c07835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "818b0bc0851b4374150d074ee90806e255c07835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.neutron [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating instance_info_cache with network_info: [{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Releasing lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Instance network_info: |[{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] Acquired lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.neutron [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Refreshing network info cache for port 92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835 --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835,backing_fmt=raw /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835,backing_fmt=raw /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk 1073741824" returned: 0 in 0.048s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "818b0bc0851b4374150d074ee90806e255c07835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b0bc0851b4374150d074ee90806e255c07835 --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Ensure instance console log exists: /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Start _get_guest_xml network_info=[{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8e713c3467ac15aff174be2881e16590',container_format='bare',created_at=2023-10-20T18:48:52Z,direct_url=<?>,disk_format='qcow2',id=ced7ad6c-0592-4839-ace8-c03da9473658,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-316877341',owner='9b0543ec4d824458b55850006d926db5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T18:48:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'ced7ad6c-0592-4839-ace8-c03da9473658'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:49:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:49:03 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8e713c3467ac15aff174be2881e16590',container_format='bare',created_at=2023-10-20T18:48:52Z,direct_url=<?>,disk_format='qcow2',id=ced7ad6c-0592-4839-ace8-c03da9473658,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-316877341',owner='9b0543ec4d824458b55850006d926db5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T18:48:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1766705271',display_name='tempest-TestStampPattern-server-1766705271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1766705271',id=50,image_ref='ced7ad6c-0592-4839-ace8-c03da9473658',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWIEzEytNx+0iLAF9D9Qv3+Y3r8LsCO0PwIW8Ba0vdZ2VJMMmSuEA8Xu99yvdhZBUE1N8gxoPVcJJT8rE0rhk05C/y/8pli4AHOH9u2UNcRdFazrgnJROLfVddmOzPrqw==',key_name='tempest-TestStampPattern-1283546229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b0543ec4d824458b55850006d926db5',ramdisk_id='',reservation_id='r-w2v5cvz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f98ef9b9-e0f6-453b-a80d-8094a4e7fabc',image_min_disk='1',image_min_ram='0',image_owner_id='9b0543ec4d824458b55850006d926db5',image_owner_project_name='tempest-TestStampPattern-1502495783',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1502495783-project-member',image_user_id='5a55ce39c0754618bee0c15cc7c62194',network_allocated='True',owner_project_name='tempest-TestStampPattern-1502495783',owner_user_name='tempest-TestStampPattern-1502495783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:49:01Z,user_data=None,user_id='5a55ce39c0754618bee0c15cc7c62194',uuid=c00683e4-9d50-40cc-b365-ade3d26abdfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converting VIF {"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.objects.instance [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'pci_devices' on Instance uuid c00683e4-9d50-40cc-b365-ade3d26abdfb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:49:03 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:49:03 user nova-compute[74233]:   <uuid>c00683e4-9d50-40cc-b365-ade3d26abdfb</uuid>
Oct 20 18:49:03 user nova-compute[74233]:   <name>instance-00000032</name>
Oct 20 18:49:03 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:49:03 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:49:03 user nova-compute[74233]:   <metadata>
Oct 20 18:49:03 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:49:03 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:49:03 user nova-compute[74233]:       <nova:name>tempest-TestStampPattern-server-1766705271</nova:name>
Oct 20 18:49:03 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:49:03</nova:creationTime>
Oct 20 18:49:03 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:49:03 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:49:03 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:49:03 user nova-compute[74233]:       <nova:owner>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:user uuid="5a55ce39c0754618bee0c15cc7c62194">tempest-TestStampPattern-1502495783-project-member</nova:user>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:project uuid="9b0543ec4d824458b55850006d926db5">tempest-TestStampPattern-1502495783</nova:project>
Oct 20 18:49:03 user nova-compute[74233]:       </nova:owner>
Oct 20 18:49:03 user nova-compute[74233]:       <nova:root type="image" uuid="ced7ad6c-0592-4839-ace8-c03da9473658"/>
Oct 20 18:49:03 user nova-compute[74233]:       <nova:ports>
Oct 20 18:49:03 user nova-compute[74233]:         <nova:port uuid="92ed642f-afa3-4264-9960-59a7bf139293">
Oct 20 18:49:03 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 18:49:03 user nova-compute[74233]:         </nova:port>
Oct 20 18:49:03 user nova-compute[74233]:       </nova:ports>
Oct 20 18:49:03 user nova-compute[74233]:     </nova:instance>
Oct 20 18:49:03 user nova-compute[74233]:   </metadata>
Oct 20 18:49:03 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:49:03 user nova-compute[74233]:     <system>
Oct 20 18:49:03 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:49:03 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:49:03 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:49:03 user nova-compute[74233]:       <entry name="serial">c00683e4-9d50-40cc-b365-ade3d26abdfb</entry>
Oct 20 18:49:03 user nova-compute[74233]:       <entry name="uuid">c00683e4-9d50-40cc-b365-ade3d26abdfb</entry>
Oct 20 18:49:03 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:49:03 user nova-compute[74233]:     </system>
Oct 20 18:49:03 user nova-compute[74233]:   </sysinfo>
Oct 20 18:49:03 user nova-compute[74233]:   <os>
Oct 20 18:49:03 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:49:03 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:49:03 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:49:03 user nova-compute[74233]:   </os>
Oct 20 18:49:03 user nova-compute[74233]:   <features>
Oct 20 18:49:03 user nova-compute[74233]:     <acpi/>
Oct 20 18:49:03 user nova-compute[74233]:     <apic/>
Oct 20 18:49:03 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:49:03 user nova-compute[74233]:   </features>
Oct 20 18:49:03 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:49:03 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:49:03 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:49:03 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:49:03 user nova-compute[74233]:   </clock>
Oct 20 18:49:03 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:49:03 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:49:03 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:49:03 user nova-compute[74233]:   </cpu>
Oct 20 18:49:03 user nova-compute[74233]:   <devices>
Oct 20 18:49:03 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:49:03 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:49:03 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk"/>
Oct 20 18:49:03 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:49:03 user nova-compute[74233]:     </disk>
Oct 20 18:49:03 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:49:03 user nova-compute[74233]:       <mac address="fa:16:3e:bd:8a:cc"/>
Oct 20 18:49:03 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:49:03 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:49:03 user nova-compute[74233]:       <target dev="tap92ed642f-af"/>
Oct 20 18:49:03 user nova-compute[74233]:     </interface>
Oct 20 18:49:03 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:49:03 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/console.log" append="off"/>
Oct 20 18:49:03 user nova-compute[74233]:     </serial>
Oct 20 18:49:03 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:49:03 user nova-compute[74233]:     <video>
Oct 20 18:49:03 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:49:03 user nova-compute[74233]:     </video>
Oct 20 18:49:03 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:49:03 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:49:03 user nova-compute[74233]:     </rng>
Oct 20 18:49:03 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:49:03 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:49:03 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:49:03 user nova-compute[74233]:     </memballoon>
Oct 20 18:49:03 user nova-compute[74233]:   </devices>
Oct 20 18:49:03 user nova-compute[74233]: </domain>
Oct 20 18:49:03 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1766705271',display_name='tempest-TestStampPattern-server-1766705271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1766705271',id=50,image_ref='ced7ad6c-0592-4839-ace8-c03da9473658',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWIEzEytNx+0iLAF9D9Qv3+Y3r8LsCO0PwIW8Ba0vdZ2VJMMmSuEA8Xu99yvdhZBUE1N8gxoPVcJJT8rE0rhk05C/y/8pli4AHOH9u2UNcRdFazrgnJROLfVddmOzPrqw==',key_name='tempest-TestStampPattern-1283546229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b0543ec4d824458b55850006d926db5',ramdisk_id='',reservation_id='r-w2v5cvz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f98ef9b9-e0f6-453b-a80d-8094a4e7fabc',image_min_disk='1',image_min_ram='0',image_owner_id='9b0543ec4d824458b55850006d926db5',image_owner_project_name='tempest-TestStampPattern-1502495783',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1502495783-project-member',image_user_id='5a55ce39c0754618bee0c15cc7c62194',network_allocated='True',owner_project_name='tempest-TestStampPattern-1502495783',owner_user_name='tempest-TestStampPattern-1502495783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:49:01Z,user_data=None,user_id='5a55ce39c0754618bee0c15cc7c62194',uuid=c00683e4-9d50-40cc-b365-ade3d26abdfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converting VIF {"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG os_vif [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updated VIF entry in instance network info cache for port 92ed642f-afa3-4264-9960-59a7bf139293. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating instance_info_cache with network_info: [{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '831b972d-6a97-5f42-b2c6-1bd494914bf6', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92ed642f-af, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92ed642f-af, col_values=(('qos', UUID('f0c6c497-2b29-499b-b539-1d35e8c7e154')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92ed642f-af, col_values=(('external_ids', {'iface-id': '92ed642f-afa3-4264-9960-59a7bf139293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:8a:cc', 'vm-uuid': 'c00683e4-9d50-40cc-b365-ade3d26abdfb'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-c1e48875-5bef-483b-acf0-decce78f4ad1 req-a3da3906-111e-4c34-a94b-b73e1feed072 service nova] Releasing lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:04 user nova-compute[74233]: INFO os_vif [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af')
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No VIF found with MAC fa:16:3e:bd:8a:cc, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:04 user nova-compute[74233]: INFO nova.compute.manager [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Detaching volume 93ced1eb-7263-4c25-b1f3-7a97265fc5a9
Oct 20 18:49:04 user nova-compute[74233]: INFO nova.virt.block_device [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Attempting to driver detach volume 93ced1eb-7263-4c25-b1f3-7a97265fc5a9 from mountpoint /dev/vdb
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Attempting to detach device vdb from instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:49:04 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:49:04 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:49:04 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:49:04 user nova-compute[74233]:   <serial>93ced1eb-7263-4c25-b1f3-7a97265fc5a9</serial>
Oct 20 18:49:04 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:49:04 user nova-compute[74233]: </disk>
Oct 20 18:49:04 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:49:04 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully detached device vdb from instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb from the persistent domain config.
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:49:04 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:49:04 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:49:04 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:49:04 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:49:04 user nova-compute[74233]:   <serial>93ced1eb-7263-4c25-b1f3-7a97265fc5a9</serial>
Oct 20 18:49:04 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:49:04 user nova-compute[74233]: </disk>
Oct 20 18:49:04 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:49:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:49:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-5628b1fd-2510-470c-8f24-66919fbb10e4 req-461c8833-ab37-4264-8014-8e2cca599352 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:49:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5628b1fd-2510-470c-8f24-66919fbb10e4 req-461c8833-ab37-4264-8014-8e2cca599352 service nova] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5628b1fd-2510-470c-8f24-66919fbb10e4 req-461c8833-ab37-4264-8014-8e2cca599352 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5628b1fd-2510-470c-8f24-66919fbb10e4 req-461c8833-ab37-4264-8014-8e2cca599352 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-5628b1fd-2510-470c-8f24-66919fbb10e4 req-461c8833-ab37-4264-8014-8e2cca599352 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] No waiting events found dispatching network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:49:06 user nova-compute[74233]: WARNING nova.compute.manager [req-5628b1fd-2510-470c-8f24-66919fbb10e4 req-461c8833-ab37-4264-8014-8e2cca599352 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received unexpected event network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 for instance with vm_state building and task_state spawning.
Oct 20 18:49:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:07 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:49:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:49:07 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Instance spawned successfully.
Oct 20 18:49:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:49:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:49:07 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:49:08 user nova-compute[74233]: INFO nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Took 7.10 seconds to spawn the instance on the hypervisor.
Oct 20 18:49:08 user nova-compute[74233]: DEBUG nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:49:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-5781019e-1a54-4a49-9f9e-96013645af44 req-8811574f-3612-4237-ab2b-7f553c43a947 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:49:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5781019e-1a54-4a49-9f9e-96013645af44 req-8811574f-3612-4237-ab2b-7f553c43a947 service nova] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5781019e-1a54-4a49-9f9e-96013645af44 req-8811574f-3612-4237-ab2b-7f553c43a947 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5781019e-1a54-4a49-9f9e-96013645af44 req-8811574f-3612-4237-ab2b-7f553c43a947 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:08 user nova-compute[74233]: DEBUG nova.compute.manager [req-5781019e-1a54-4a49-9f9e-96013645af44 req-8811574f-3612-4237-ab2b-7f553c43a947 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] No waiting events found dispatching network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:49:08 user nova-compute[74233]: WARNING nova.compute.manager [req-5781019e-1a54-4a49-9f9e-96013645af44 req-8811574f-3612-4237-ab2b-7f553c43a947 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received unexpected event network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 for instance with vm_state building and task_state spawning.
Oct 20 18:49:08 user nova-compute[74233]: INFO nova.compute.manager [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Took 7.74 seconds to build instance.
Oct 20 18:49:08 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-3cc6aebf-db3f-4aa8-9636-31ebdf654f8b tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.867s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:09 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:49:18 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:19 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:49:23 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb is timed out.
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully detached device vdb from instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb from the live domain config.
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmoWOUid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:49:25 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aa085d-5ae9-4cf1-9a9c-65cd2ab9291d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:49:25 user nova-compute[74233]: No targets found.
Oct 20 18:49:25 user nova-compute[74233]: iSNS:
Oct 20 18:49:25 user nova-compute[74233]: No targets found.
Oct 20 18:49:25 user nova-compute[74233]: STATIC:
Oct 20 18:49:25 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9
Oct 20 18:49:25 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:49:25 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:49:25 user nova-compute[74233]: FIRMWARE:
Oct 20 18:49:25 user nova-compute[74233]: No targets found.
Oct 20 18:49:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:49:25 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:49:25 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[69336651-faec-44a9-aaf5-81a8cd0f6ae1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[053538bb-561e-4b5b-a2f7-8f2e5dcb7453]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 (non-flash)
Oct 20 18:49:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 (non-flash)
Oct 20 18:49:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9802ad900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9b565-91dd-4e8d-8fac-027baadb6e34]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f965a7db-1b2c-4606-ba49-66da5948e290]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5b8fd9-328e-45b0-acf9-eb6db7b36533]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[37020e96-c72f-418d-910c-8784e7862afd]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:49:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=24.845317840576172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd406b0-44b4-4691-b18e-c89509ec6487]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d04230-e6ce-4edb-b50c-2136c7fe6a55]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260]
Oct 20 18:49:25 user nova-compute[74233]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9, portal: 172.16.0.220,3260] successful.
Oct 20 18:49:25 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1004cdbb-4365-4e3a-bfab-75f39406d6d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c00683e4-9d50-40cc-b365-ade3d26abdfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:49:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ced1eb-7263-4c25-b1f3-7a97265fc5a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19042ef9-3bd5-4dbd-ad28-772984be17ee]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.618s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== disconnect_volume: return (621ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid c7d85b1c-5983-491a-8af1-51ba6bf0e9bb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:49:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cfe2fbc6-bb2d-4a66-ae5f-e2e4a311ce33 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.168s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:29 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:31 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:34 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:34 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:49:35 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:49:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:49:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:49:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:49:36 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:36 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:49:39 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:44 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:49:49 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:49:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:49:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:49:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:49:54 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:55 user nova-compute[74233]: INFO nova.compute.manager [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Terminating instance
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.compute.manager [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-41fbdb6c-0ba2-471a-b2c0-4c56588b3e47 req-64f6fe12-9840-45bc-9d9e-6f6c804034f0 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-vif-unplugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-41fbdb6c-0ba2-471a-b2c0-4c56588b3e47 req-64f6fe12-9840-45bc-9d9e-6f6c804034f0 service nova] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-41fbdb6c-0ba2-471a-b2c0-4c56588b3e47 req-64f6fe12-9840-45bc-9d9e-6f6c804034f0 service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-41fbdb6c-0ba2-471a-b2c0-4c56588b3e47 req-64f6fe12-9840-45bc-9d9e-6f6c804034f0 service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-41fbdb6c-0ba2-471a-b2c0-4c56588b3e47 req-64f6fe12-9840-45bc-9d9e-6f6c804034f0 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] No waiting events found dispatching network-vif-unplugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.compute.manager [req-41fbdb6c-0ba2-471a-b2c0-4c56588b3e47 req-64f6fe12-9840-45bc-9d9e-6f6c804034f0 service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-vif-unplugged-3880e123-660a-49de-a525-bd670027ceff for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Instance destroyed successfully.
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.objects.instance [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'resources' on Instance uuid c7d85b1c-5983-491a-8af1-51ba6bf0e9bb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1005036057',display_name='tempest-AttachVolumeNegativeTest-server-1005036057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1005036057',id=48,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMPPu9Vr4eLILC/5CL1ebkXPY1UEeA+fMpXBd6DA+/RCXhWPEXznzTzcn2hcqhyVL60xCPv/FgWjl0aG8ae71+oWzZNTclhPo009phAbEWveeawQbjUcBOGe3jIxpI+2w==',key_name='tempest-keypair-2057378308',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-9gj8fr2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:46:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=c7d85b1c-5983-491a-8af1-51ba6bf0e9bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "3880e123-660a-49de-a525-bd670027ceff", "address": "fa:16:3e:3c:09:b3", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3880e123-66", "ovs_interfaceid": "3880e123-660a-49de-a525-bd670027ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG os_vif [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3880e123-66, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a2eb5c8-7c0a-4d00-98d3-9536da6b8496) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:49:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:49:55 user nova-compute[74233]: INFO os_vif [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:09:b3,bridge_name='br-int',has_traffic_filtering=True,id=3880e123-660a-49de-a525-bd670027ceff,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3880e123-66')
Oct 20 18:49:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Deleting instance files /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb_del
Oct 20 18:49:55 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Deletion of /opt/stack/data/nova/instances/c7d85b1c-5983-491a-8af1-51ba6bf0e9bb_del complete
Oct 20 18:49:56 user nova-compute[74233]: INFO nova.compute.manager [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 20 18:49:56 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:49:56 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:49:56 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:49:56 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:49:56 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Took 0.67 seconds to deallocate network for instance.
Oct 20 18:49:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:56 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:57 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Deleted allocations for instance c7d85b1c-5983-491a-8af1-51ba6bf0e9bb
Oct 20 18:49:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-11aa40de-07f1-4a46-b0dc-44888296c24e tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] Acquiring lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] Lock "c7d85b1c-5983-491a-8af1-51ba6bf0e9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:49:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] No waiting events found dispatching network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:49:57 user nova-compute[74233]: WARNING nova.compute.manager [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received unexpected event network-vif-plugged-3880e123-660a-49de-a525-bd670027ceff for instance with vm_state deleted and task_state None.
Oct 20 18:49:57 user nova-compute[74233]: DEBUG nova.compute.manager [req-9d6a1943-1c28-485c-9c2a-ed0179b534cd req-c93f7b23-d1ad-42ab-bb56-bc01f864fd7e service nova] [instance: c7d85b1c-5983-491a-8af1-51ba6bf0e9bb] Received event network-vif-deleted-3880e123-660a-49de-a525-bd670027ceff {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:50:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:50:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:50:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:50:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:50:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:50:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=24.87179946899414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 1004cdbb-4365-4e3a-bfab-75f39406d6d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c00683e4-9d50-40cc-b365-ade3d26abdfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:50:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:50:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:50:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:50:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:35 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:50:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:50:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:50:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:50:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updating instance_info_cache with network_info: [{"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:50:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-1004cdbb-4365-4e3a-bfab-75f39406d6d1" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:50:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:50:36 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:38 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:50:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:50:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:50:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:50:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:43 user nova-compute[74233]: INFO nova.compute.manager [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Terminating instance
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.compute.manager [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ad67b98-c8ef-487a-8ce5-61459a762697 req-9c018357-af21-4e4b-8c62-04b98e7aa07d service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-vif-unplugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ad67b98-c8ef-487a-8ce5-61459a762697 req-9c018357-af21-4e4b-8c62-04b98e7aa07d service nova] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ad67b98-c8ef-487a-8ce5-61459a762697 req-9c018357-af21-4e4b-8c62-04b98e7aa07d service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9ad67b98-c8ef-487a-8ce5-61459a762697 req-9c018357-af21-4e4b-8c62-04b98e7aa07d service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ad67b98-c8ef-487a-8ce5-61459a762697 req-9c018357-af21-4e4b-8c62-04b98e7aa07d service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] No waiting events found dispatching network-vif-unplugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.compute.manager [req-9ad67b98-c8ef-487a-8ce5-61459a762697 req-9c018357-af21-4e4b-8c62-04b98e7aa07d service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-vif-unplugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Instance destroyed successfully.
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.objects.instance [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lazy-loading 'resources' on Instance uuid 1004cdbb-4365-4e3a-bfab-75f39406d6d1 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-459281734',display_name='tempest-VolumesActionsTest-instance-459281734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-459281734',id=49,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:48:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31b5963ae3b94c3a876cc013c8133fe8',ramdisk_id='',reservation_id='r-cnnes0s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1731323280',owner_user_name='tempest-VolumesActionsTest-1731323280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:48:58Z,user_data=None,user_id='f203dfc0b2454a2e8b2f5e4c77e9de16',uuid=1004cdbb-4365-4e3a-bfab-75f39406d6d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converting VIF {"id": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "address": "fa:16:3e:10:be:b3", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44d3ca1-8d", "ovs_interfaceid": "e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG os_vif [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape44d3ca1-8d, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7dc2bd7-06b2-4071-8aed-6b0c2796ede8) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:43 user nova-compute[74233]: INFO os_vif [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44d3ca1-8d')
Oct 20 18:50:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Deleting instance files /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1_del
Oct 20 18:50:43 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Deletion of /opt/stack/data/nova/instances/1004cdbb-4365-4e3a-bfab-75f39406d6d1_del complete
Oct 20 18:50:43 user nova-compute[74233]: INFO nova.compute.manager [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 18:50:43 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:50:43 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:50:44 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Took 0.69 seconds to deallocate network for instance.
Oct 20 18:50:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-4068b4c6-5c9c-4a78-96cf-a5c4c330bfb3 req-d49305a4-d3fb-49c0-9b26-9359d8ee1693 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-vif-deleted-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:44 user nova-compute[74233]: INFO nova.compute.manager [req-4068b4c6-5c9c-4a78-96cf-a5c4c330bfb3 req-d49305a4-d3fb-49c0-9b26-9359d8ee1693 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Neutron deleted interface e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1; detaching it from the instance and deleting it from the info cache
Oct 20 18:50:44 user nova-compute[74233]: DEBUG nova.network.neutron [req-4068b4c6-5c9c-4a78-96cf-a5c4c330bfb3 req-d49305a4-d3fb-49c0-9b26-9359d8ee1693 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG nova.compute.manager [req-4068b4c6-5c9c-4a78-96cf-a5c4c330bfb3 req-d49305a4-d3fb-49c0-9b26-9359d8ee1693 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Detach interface failed, port_id=e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1, reason: Instance 1004cdbb-4365-4e3a-bfab-75f39406d6d1 could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:50:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:44 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Deleted allocations for instance 1004cdbb-4365-4e3a-bfab-75f39406d6d1
Oct 20 18:50:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-f8191c41-7d57-42f9-84ac-3c7f9e619735 tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-282860f8-9589-4818-a49d-97f4e97bc588 req-7462a44d-d8c7-45b2-90b7-72e1eae83088 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received event network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-282860f8-9589-4818-a49d-97f4e97bc588 req-7462a44d-d8c7-45b2-90b7-72e1eae83088 service nova] Acquiring lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-282860f8-9589-4818-a49d-97f4e97bc588 req-7462a44d-d8c7-45b2-90b7-72e1eae83088 service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:45 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-282860f8-9589-4818-a49d-97f4e97bc588 req-7462a44d-d8c7-45b2-90b7-72e1eae83088 service nova] Lock "1004cdbb-4365-4e3a-bfab-75f39406d6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:45 user nova-compute[74233]: DEBUG nova.compute.manager [req-282860f8-9589-4818-a49d-97f4e97bc588 req-7462a44d-d8c7-45b2-90b7-72e1eae83088 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] No waiting events found dispatching network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:50:45 user nova-compute[74233]: WARNING nova.compute.manager [req-282860f8-9589-4818-a49d-97f4e97bc588 req-7462a44d-d8c7-45b2-90b7-72e1eae83088 service nova] [instance: 1004cdbb-4365-4e3a-bfab-75f39406d6d1] Received unexpected event network-vif-plugged-e44d3ca1-8dd1-44c8-9d3d-597d21ebbda1 for instance with vm_state deleted and task_state None.
Oct 20 18:50:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:50:48 user nova-compute[74233]: INFO nova.compute.claims [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Claim successful on node user
Oct 20 18:50:48 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:50:48 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:50:49 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.policy [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efaee4f6f36e458184f3aa737affdbc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a650cec6e38447d5a36decea9b4f4a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:50:49 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Creating image(s)
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "/opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "/opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk 1073741824" returned: 0 in 0.056s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Successfully created port: c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.178s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:50:49 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Cannot resize image /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Ensure instance console log exists: /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Successfully updated port: c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquired lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-changed-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.compute.manager [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Refreshing instance network info cache due to event network-changed-c0518cb3-bff0-4ec7-90b1-88234ff403a0. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] Acquiring lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.neutron [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updating instance_info_cache with network_info: [{"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Releasing lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Instance network_info: |[{"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] Acquired lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.neutron [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Refreshing network info cache for port c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Start _get_guest_xml network_info=[{"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:50:50 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:50:50 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2074515100',display_name='tempest-AttachVolumeNegativeTest-server-2074515100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2074515100',id=51,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+IhEE5cm6d0sST+6VY2Gy2FywqSds6/7QKp03xlpVt/oJbIfb4sIYtcMWnYFdl7Ai74H/jAC7UQ85LIt8rLTIOrxsRA4qMMTVxH6Jky0muUQU3MkLofVj7duy6KIQYrA==',key_name='tempest-keypair-1101056717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-qukrea1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:50:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=248efd4c-164b-49ba-808b-89434fbb5639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.objects.instance [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'pci_devices' on Instance uuid 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:50:50 user nova-compute[74233]:   <uuid>248efd4c-164b-49ba-808b-89434fbb5639</uuid>
Oct 20 18:50:50 user nova-compute[74233]:   <name>instance-00000033</name>
Oct 20 18:50:50 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:50:50 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:50:50 user nova-compute[74233]:   <metadata>
Oct 20 18:50:50 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:50:50 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:50:50 user nova-compute[74233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2074515100</nova:name>
Oct 20 18:50:50 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:50:50</nova:creationTime>
Oct 20 18:50:50 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:50:50 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:50:50 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:50:50 user nova-compute[74233]:       <nova:owner>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:user uuid="efaee4f6f36e458184f3aa737affdbc2">tempest-AttachVolumeNegativeTest-375409870-project-member</nova:user>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:project uuid="a650cec6e38447d5a36decea9b4f4a30">tempest-AttachVolumeNegativeTest-375409870</nova:project>
Oct 20 18:50:50 user nova-compute[74233]:       </nova:owner>
Oct 20 18:50:50 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:50:50 user nova-compute[74233]:       <nova:ports>
Oct 20 18:50:50 user nova-compute[74233]:         <nova:port uuid="c0518cb3-bff0-4ec7-90b1-88234ff403a0">
Oct 20 18:50:50 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:50:50 user nova-compute[74233]:         </nova:port>
Oct 20 18:50:50 user nova-compute[74233]:       </nova:ports>
Oct 20 18:50:50 user nova-compute[74233]:     </nova:instance>
Oct 20 18:50:50 user nova-compute[74233]:   </metadata>
Oct 20 18:50:50 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:50:50 user nova-compute[74233]:     <system>
Oct 20 18:50:50 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:50:50 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:50:50 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:50:50 user nova-compute[74233]:       <entry name="serial">248efd4c-164b-49ba-808b-89434fbb5639</entry>
Oct 20 18:50:50 user nova-compute[74233]:       <entry name="uuid">248efd4c-164b-49ba-808b-89434fbb5639</entry>
Oct 20 18:50:50 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:50:50 user nova-compute[74233]:     </system>
Oct 20 18:50:50 user nova-compute[74233]:   </sysinfo>
Oct 20 18:50:50 user nova-compute[74233]:   <os>
Oct 20 18:50:50 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:50:50 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:50:50 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:50:50 user nova-compute[74233]:   </os>
Oct 20 18:50:50 user nova-compute[74233]:   <features>
Oct 20 18:50:50 user nova-compute[74233]:     <acpi/>
Oct 20 18:50:50 user nova-compute[74233]:     <apic/>
Oct 20 18:50:50 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:50:50 user nova-compute[74233]:   </features>
Oct 20 18:50:50 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:50:50 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:50:50 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:50:50 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:50:50 user nova-compute[74233]:   </clock>
Oct 20 18:50:50 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:50:50 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:50:50 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:50:50 user nova-compute[74233]:   </cpu>
Oct 20 18:50:50 user nova-compute[74233]:   <devices>
Oct 20 18:50:50 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:50:50 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:50:50 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk"/>
Oct 20 18:50:50 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:50:50 user nova-compute[74233]:     </disk>
Oct 20 18:50:50 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:50:50 user nova-compute[74233]:       <mac address="fa:16:3e:80:12:bc"/>
Oct 20 18:50:50 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:50:50 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:50:50 user nova-compute[74233]:       <target dev="tapc0518cb3-bf"/>
Oct 20 18:50:50 user nova-compute[74233]:     </interface>
Oct 20 18:50:50 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:50:50 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/console.log" append="off"/>
Oct 20 18:50:50 user nova-compute[74233]:     </serial>
Oct 20 18:50:50 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:50:50 user nova-compute[74233]:     <video>
Oct 20 18:50:50 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:50:50 user nova-compute[74233]:     </video>
Oct 20 18:50:50 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:50:50 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:50:50 user nova-compute[74233]:     </rng>
Oct 20 18:50:50 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:50:50 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:50:50 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:50:50 user nova-compute[74233]:     </memballoon>
Oct 20 18:50:50 user nova-compute[74233]:   </devices>
Oct 20 18:50:50 user nova-compute[74233]: </domain>
Oct 20 18:50:50 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2074515100',display_name='tempest-AttachVolumeNegativeTest-server-2074515100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2074515100',id=51,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+IhEE5cm6d0sST+6VY2Gy2FywqSds6/7QKp03xlpVt/oJbIfb4sIYtcMWnYFdl7Ai74H/jAC7UQ85LIt8rLTIOrxsRA4qMMTVxH6Jky0muUQU3MkLofVj7duy6KIQYrA==',key_name='tempest-keypair-1101056717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-qukrea1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:50:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=248efd4c-164b-49ba-808b-89434fbb5639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG os_vif [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcf06cb0-9928-5f04-9af5-0dddfec141bd', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0518cb3-bf, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0518cb3-bf, col_values=(('qos', UUID('8f4fc524-7890-4f18-a9ad-f53ae03d2df4')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0518cb3-bf, col_values=(('external_ids', {'iface-id': 'c0518cb3-bff0-4ec7-90b1-88234ff403a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:12:bc', 'vm-uuid': '248efd4c-164b-49ba-808b-89434fbb5639'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:50 user nova-compute[74233]: INFO os_vif [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf')
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:50:50 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:80:12:bc, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:50:51 user nova-compute[74233]: DEBUG nova.network.neutron [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updated VIF entry in instance network info cache for port c0518cb3-bff0-4ec7-90b1-88234ff403a0. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:50:51 user nova-compute[74233]: DEBUG nova.network.neutron [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updating instance_info_cache with network_info: [{"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:50:51 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-f3cc6e1d-8968-4150-b519-a77d4b8dadb7 req-e6d88721-d3d5-489f-af2b-5d36c8cce55f service nova] Releasing lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:50:51 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-9328c200-7c74-4c1d-b054-1f6369f4f0af req-a2cae601-3647-4220-8823-5d6a93211aa1 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9328c200-7c74-4c1d-b054-1f6369f4f0af req-a2cae601-3647-4220-8823-5d6a93211aa1 service nova] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9328c200-7c74-4c1d-b054-1f6369f4f0af req-a2cae601-3647-4220-8823-5d6a93211aa1 service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9328c200-7c74-4c1d-b054-1f6369f4f0af req-a2cae601-3647-4220-8823-5d6a93211aa1 service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG nova.compute.manager [req-9328c200-7c74-4c1d-b054-1f6369f4f0af req-a2cae601-3647-4220-8823-5d6a93211aa1 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] No waiting events found dispatching network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:50:52 user nova-compute[74233]: WARNING nova.compute.manager [req-9328c200-7c74-4c1d-b054-1f6369f4f0af req-a2cae601-3647-4220-8823-5d6a93211aa1 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received unexpected event network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 for instance with vm_state building and task_state spawning.
Oct 20 18:50:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG nova.objects.instance [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'flavor' on Instance uuid c00683e4-9d50-40cc-b365-ade3d26abdfb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:53 user nova-compute[74233]: INFO nova.compute.manager [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Attaching volume cceacf02-cf5b-44ee-b687-aa9913bbe34b to /dev/vdb
Oct 20 18:50:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c08543c-4a75-4501-8e7f-950a623aec5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c321b9-53cc-4911-b1a5-ff05d32629d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e466d738-61ba-4c28-a700-d3af91bf5efd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4713f4-683c-4a5a-bba3-0a33a2be8e7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:50:53 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:50:53 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314cc3c-4b68-4c4b-94d2-d400ccd81028]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG os_brick.utils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:50:53 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating existing volume attachment record: 0c7e5d83-020a-45fa-922d-3d68ad424e89 {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:50:54 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Instance spawned successfully.
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:50:54 user nova-compute[74233]: INFO nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:50:54 user nova-compute[74233]: INFO nova.compute.manager [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Took 5.51 seconds to build instance.
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-6f6c32dc-4daf-49fd-ad1a-44153a04a477 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.596s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] No waiting events found dispatching network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:50:54 user nova-compute[74233]: WARNING nova.compute.manager [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received unexpected event network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 for instance with vm_state active and task_state None.
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-changed-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.compute.manager [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Refreshing instance network info cache due to event network-changed-92ed642f-afa3-4264-9960-59a7bf139293. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] Acquiring lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] Acquired lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Refreshing network info cache for port 92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updated VIF entry in instance network info cache for port 92ed642f-afa3-4264-9960-59a7bf139293. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG nova.network.neutron [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating instance_info_cache with network_info: [{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:50:54 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-335b7626-ccab-46e5-a28e-7acf6ce22f40 req-71df69f0-9c50-4436-b051-0c820f1db43c service nova] Releasing lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:50:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:50:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrXojBwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:51:09 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:51:09 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:51:09 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e27bd0-1d69-453e-ab35-13fe9e425ebe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:51:09 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b019436-a079-436f-9d18-f47bfac57cc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b] added
Oct 20 18:51:09 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec1f69-bb59-4d0d-960d-572420cc0f08]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:09 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a70871a-a3d7-4637-b5e0-6976419f347b]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrXojBwU {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrXojBwU" returned: 0 in 0.023s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21811b-2d26-43a5-a342-adfd2e1a4506]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrXojBwU'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2aeb6-7a7e-401e-9cfc-bca47dc72647]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96a4a1-2a4c-4d0c-b0ab-905242d22c94]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:51:10 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:51:10 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:51:10 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:51:10 user nova-compute[74233]: 
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae49fa25-4813-4175-b841-5e80f3a2e69b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260]
Oct 20 18:51:10 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260] successful.
Oct 20 18:51:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7d657-a7f1-4549-b902-304c5192aede]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93067f6-2b4d-4db9-872d-a1a9a6c3d31a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b (non-flash)
Oct 20 18:51:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b (non-flash)
Oct 20 18:51:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd53157-d17e-4a64-8e0f-67e38128a40c]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:51:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrXojBwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26530346464346562', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530346464346562', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'flavor' on Instance uuid c00683e4-9d50-40cc-b365-ade3d26abdfb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:51:11 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:51:11 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:51:11 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:51:11 user nova-compute[74233]:   <serial>cceacf02-cf5b-44ee-b687-aa9913bbe34b</serial>
Oct 20 18:51:11 user nova-compute[74233]: </disk>
Oct 20 18:51:11 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] No VIF found with MAC fa:16:3e:bd:8a:cc, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:51:11 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-87641235-a40d-4fc0-b706-e33cc4735e34 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.459s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:13 user nova-compute[74233]: INFO nova.compute.manager [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Detaching volume cceacf02-cf5b-44ee-b687-aa9913bbe34b
Oct 20 18:51:13 user nova-compute[74233]: INFO nova.virt.block_device [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Attempting to driver detach volume cceacf02-cf5b-44ee-b687-aa9913bbe34b from mountpoint /dev/vdb
Oct 20 18:51:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Attempting to detach device vdb from instance c00683e4-9d50-40cc-b365-ade3d26abdfb from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:51:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:51:13 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:51:13 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:51:13 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:51:13 user nova-compute[74233]:   <serial>cceacf02-cf5b-44ee-b687-aa9913bbe34b</serial>
Oct 20 18:51:13 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:51:13 user nova-compute[74233]: </disk>
Oct 20 18:51:13 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:51:13 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully detached device vdb from instance c00683e4-9d50-40cc-b365-ade3d26abdfb from the persistent domain config.
Oct 20 18:51:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c00683e4-9d50-40cc-b365-ade3d26abdfb from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:51:13 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:51:13 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:51:13 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:51:13 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:51:13 user nova-compute[74233]:   <serial>cceacf02-cf5b-44ee-b687-aa9913bbe34b</serial>
Oct 20 18:51:13 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:51:13 user nova-compute[74233]: </disk>
Oct 20 18:51:13 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:51:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c00683e4-9d50-40cc-b365-ade3d26abdfb {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:51:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:19 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:19 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:51:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:51:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:51:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=24.869213104248047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance c00683e4-9d50-40cc-b365-ade3d26abdfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 248efd4c-164b-49ba-808b-89434fbb5639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:51:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c00683e4-9d50-40cc-b365-ade3d26abdfb is timed out.
Oct 20 18:51:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully detached device vdb from instance c00683e4-9d50-40cc-b365-ade3d26abdfb from the live domain config.
Oct 20 18:51:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrXojBwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:51:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8bc5c0-3491-42a4-a0b0-8dbaeba533c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:51:34 user nova-compute[74233]: No targets found.
Oct 20 18:51:34 user nova-compute[74233]: iSNS:
Oct 20 18:51:34 user nova-compute[74233]: No targets found.
Oct 20 18:51:34 user nova-compute[74233]: STATIC:
Oct 20 18:51:34 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b
Oct 20 18:51:34 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:51:34 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:51:34 user nova-compute[74233]: FIRMWARE:
Oct 20 18:51:34 user nova-compute[74233]: No targets found.
Oct 20 18:51:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:51:34 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:51:34 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c95c5-a8ca-43f8-a047-2f11f9fe2f9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d844b418-3fe4-4193-9597-0449346bb88f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b (non-flash)
Oct 20 18:51:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b (non-flash)
Oct 20 18:51:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb970487d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d388ea7-93c4-443b-8236-fd30becf7014]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e815540-3d0c-432b-b21e-921619126d88]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f32b9e6-65ef-4a3c-acdf-d5c67446fe2f]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[296b6217-2767-40de-927b-470e5a136f7c]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14978233-91b0-4ff6-b454-1a0138af46e0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --logout" returned: 0 in 0.306s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd804a-d706-4629-9d50-ddf12f6d80ba]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260]
Oct 20 18:51:34 user nova-compute[74233]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b, portal: 172.16.0.220,3260] successful.
Oct 20 18:51:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceacf02-cf5b-44ee-b687-aa9913bbe34b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e998d80f-bcc8-427c-9d15-d9b81806efed]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.544s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] <== disconnect_volume: return (545ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Starting instance... {{(pid=74233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:34 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 18:51:34 user nova-compute[74233]: INFO nova.compute.claims [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Claim successful on node user
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Start building networks asynchronously for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Allocating IP information in the background. {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] allocate_for_instance() {{(pid=74233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 18:51:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Start building block device mappings for instance. {{(pid=74233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.policy [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f203dfc0b2454a2e8b2f5e4c77e9de16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b5963ae3b94c3a876cc013c8133fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74233) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Start spawning the instance on the hypervisor. {{(pid=74233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Creating instance directory {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 18:51:35 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Creating image(s)
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "/opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "/opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.176s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.objects.instance [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'flavor' on Instance uuid c00683e4-9d50-40cc-b365-ade3d26abdfb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk 1073741824 {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48,backing_fmt=raw /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk 1073741824" returned: 0 in 0.056s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "68b2fa2acfe69ab3df4ca3133cb16aafad6beb48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-ae35195a-91b3-4fa1-9e65-8f672620e857 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.network.neutron [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Successfully created port: cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68b2fa2acfe69ab3df4ca3133cb16aafad6beb48 --force-share --output=json" returned: 0 in 0.183s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk. size=1073741824 {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 18:51:35 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.disk.api [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Cannot resize image /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk to a smaller size. {{(pid=74233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Created local disks {{(pid=74233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Ensure instance console log exists: /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/console.log {{(pid=74233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Successfully updated port: cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "refresh_cache-f1850071-1858-4b9c-be3d-66d9d83aad4d" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquired lock "refresh_cache-f1850071-1858-4b9c-be3d-66d9d83aad4d" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Building network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-changed-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.compute.manager [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Refreshing instance network info cache due to event network-changed-cdd21dc3-6409-40e6-951f-857eaed273e0. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] Acquiring lock "refresh_cache-f1850071-1858-4b9c-be3d-66d9d83aad4d" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Instance cache missing network info. {{(pid=74233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.network.neutron [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Updating instance_info_cache with network_info: [{"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Releasing lock "refresh_cache-f1850071-1858-4b9c-be3d-66d9d83aad4d" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Instance network_info: |[{"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] Acquired lock "refresh_cache-f1850071-1858-4b9c-be3d-66d9d83aad4d" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.network.neutron [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Refreshing network info cache for port cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Start _get_guest_xml network_info=[{"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'eaa6d842-3abb-4a80-92cd-b9a50e121c9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 18:51:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:51:36 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CPU controller missing on host. {{(pid=74233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.host [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CPU controller found on host. {{(pid=74233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T18:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T18:02:12Z,direct_url=<?>,disk_format='qcow2',id=eaa6d842-3abb-4a80-92cd-b9a50e121c9f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='770c5ca287434bdd8872b323dc3c6507',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T18:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Flavor limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Image limits 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Flavor pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Image pref 0:0:0 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Got 1 possible topologies {{(pid=74233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 18:51:36 user nova-compute[74233]: DEBUG nova.virt.hardware [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1320037702',display_name='tempest-VolumesActionsTest-instance-1320037702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1320037702',id=52,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b5963ae3b94c3a876cc013c8133fe8',ramdisk_id='',reservation_id='r-b2qm6gsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1731323280',owner_user_name='tempest-VolumesActionsTest-1731323280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:51:35Z,user_data=None,user_id='f203dfc0b2454a2e8b2f5e4c77e9de16',uuid=f1850071-1858-4b9c-be3d-66d9d83aad4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converting VIF {"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.objects.instance [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lazy-loading 'pci_devices' on Instance uuid f1850071-1858-4b9c-be3d-66d9d83aad4d {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 18:51:37 user nova-compute[74233]:   <uuid>f1850071-1858-4b9c-be3d-66d9d83aad4d</uuid>
Oct 20 18:51:37 user nova-compute[74233]:   <name>instance-00000034</name>
Oct 20 18:51:37 user nova-compute[74233]:   <memory>524288</memory>
Oct 20 18:51:37 user nova-compute[74233]:   <vcpu>1</vcpu>
Oct 20 18:51:37 user nova-compute[74233]:   <metadata>
Oct 20 18:51:37 user nova-compute[74233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 18:51:37 user nova-compute[74233]:       <nova:package version="0.0.0"/>
Oct 20 18:51:37 user nova-compute[74233]:       <nova:name>tempest-VolumesActionsTest-instance-1320037702</nova:name>
Oct 20 18:51:37 user nova-compute[74233]:       <nova:creationTime>2023-10-20 18:51:36</nova:creationTime>
Oct 20 18:51:37 user nova-compute[74233]:       <nova:flavor name="m1.tiny">
Oct 20 18:51:37 user nova-compute[74233]:         <nova:memory>512</nova:memory>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:disk>1</nova:disk>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:swap>0</nova:swap>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:vcpus>1</nova:vcpus>
Oct 20 18:51:37 user nova-compute[74233]:       </nova:flavor>
Oct 20 18:51:37 user nova-compute[74233]:       <nova:owner>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:user uuid="f203dfc0b2454a2e8b2f5e4c77e9de16">tempest-VolumesActionsTest-1731323280-project-member</nova:user>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:project uuid="31b5963ae3b94c3a876cc013c8133fe8">tempest-VolumesActionsTest-1731323280</nova:project>
Oct 20 18:51:37 user nova-compute[74233]:       </nova:owner>
Oct 20 18:51:37 user nova-compute[74233]:       <nova:root type="image" uuid="eaa6d842-3abb-4a80-92cd-b9a50e121c9f"/>
Oct 20 18:51:37 user nova-compute[74233]:       <nova:ports>
Oct 20 18:51:37 user nova-compute[74233]:         <nova:port uuid="cdd21dc3-6409-40e6-951f-857eaed273e0">
Oct 20 18:51:37 user nova-compute[74233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 18:51:37 user nova-compute[74233]:         </nova:port>
Oct 20 18:51:37 user nova-compute[74233]:       </nova:ports>
Oct 20 18:51:37 user nova-compute[74233]:     </nova:instance>
Oct 20 18:51:37 user nova-compute[74233]:   </metadata>
Oct 20 18:51:37 user nova-compute[74233]:   <sysinfo type="smbios">
Oct 20 18:51:37 user nova-compute[74233]:     <system>
Oct 20 18:51:37 user nova-compute[74233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 18:51:37 user nova-compute[74233]:       <entry name="product">OpenStack Nova</entry>
Oct 20 18:51:37 user nova-compute[74233]:       <entry name="version">0.0.0</entry>
Oct 20 18:51:37 user nova-compute[74233]:       <entry name="serial">f1850071-1858-4b9c-be3d-66d9d83aad4d</entry>
Oct 20 18:51:37 user nova-compute[74233]:       <entry name="uuid">f1850071-1858-4b9c-be3d-66d9d83aad4d</entry>
Oct 20 18:51:37 user nova-compute[74233]:       <entry name="family">Virtual Machine</entry>
Oct 20 18:51:37 user nova-compute[74233]:     </system>
Oct 20 18:51:37 user nova-compute[74233]:   </sysinfo>
Oct 20 18:51:37 user nova-compute[74233]:   <os>
Oct 20 18:51:37 user nova-compute[74233]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 18:51:37 user nova-compute[74233]:     <boot dev="hd"/>
Oct 20 18:51:37 user nova-compute[74233]:     <smbios mode="sysinfo"/>
Oct 20 18:51:37 user nova-compute[74233]:   </os>
Oct 20 18:51:37 user nova-compute[74233]:   <features>
Oct 20 18:51:37 user nova-compute[74233]:     <acpi/>
Oct 20 18:51:37 user nova-compute[74233]:     <apic/>
Oct 20 18:51:37 user nova-compute[74233]:     <vmcoreinfo/>
Oct 20 18:51:37 user nova-compute[74233]:   </features>
Oct 20 18:51:37 user nova-compute[74233]:   <clock offset="utc">
Oct 20 18:51:37 user nova-compute[74233]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 18:51:37 user nova-compute[74233]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 18:51:37 user nova-compute[74233]:     <timer name="hpet" present="no"/>
Oct 20 18:51:37 user nova-compute[74233]:   </clock>
Oct 20 18:51:37 user nova-compute[74233]:   <cpu mode="custom" match="exact">
Oct 20 18:51:37 user nova-compute[74233]:     <model>Nehalem</model>
Oct 20 18:51:37 user nova-compute[74233]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 18:51:37 user nova-compute[74233]:   </cpu>
Oct 20 18:51:37 user nova-compute[74233]:   <devices>
Oct 20 18:51:37 user nova-compute[74233]:     <disk type="file" device="disk">
Oct 20 18:51:37 user nova-compute[74233]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 18:51:37 user nova-compute[74233]:       <source file="/opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk"/>
Oct 20 18:51:37 user nova-compute[74233]:       <target dev="vda" bus="virtio"/>
Oct 20 18:51:37 user nova-compute[74233]:     </disk>
Oct 20 18:51:37 user nova-compute[74233]:     <interface type="ethernet">
Oct 20 18:51:37 user nova-compute[74233]:       <mac address="fa:16:3e:06:72:4f"/>
Oct 20 18:51:37 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:51:37 user nova-compute[74233]:       <mtu size="1442"/>
Oct 20 18:51:37 user nova-compute[74233]:       <target dev="tapcdd21dc3-64"/>
Oct 20 18:51:37 user nova-compute[74233]:     </interface>
Oct 20 18:51:37 user nova-compute[74233]:     <serial type="pty">
Oct 20 18:51:37 user nova-compute[74233]:       <log file="/opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/console.log" append="off"/>
Oct 20 18:51:37 user nova-compute[74233]:     </serial>
Oct 20 18:51:37 user nova-compute[74233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 18:51:37 user nova-compute[74233]:     <video>
Oct 20 18:51:37 user nova-compute[74233]:       <model type="virtio"/>
Oct 20 18:51:37 user nova-compute[74233]:     </video>
Oct 20 18:51:37 user nova-compute[74233]:     <rng model="virtio">
Oct 20 18:51:37 user nova-compute[74233]:       <backend model="random">/dev/urandom</backend>
Oct 20 18:51:37 user nova-compute[74233]:     </rng>
Oct 20 18:51:37 user nova-compute[74233]:     <controller type="usb" index="0" model="none"/>
Oct 20 18:51:37 user nova-compute[74233]:     <memballoon model="virtio">
Oct 20 18:51:37 user nova-compute[74233]:       <stats period="10"/>
Oct 20 18:51:37 user nova-compute[74233]:     </memballoon>
Oct 20 18:51:37 user nova-compute[74233]:   </devices>
Oct 20 18:51:37 user nova-compute[74233]: </domain>
Oct 20 18:51:37 user nova-compute[74233]:  {{(pid=74233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1320037702',display_name='tempest-VolumesActionsTest-instance-1320037702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1320037702',id=52,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31b5963ae3b94c3a876cc013c8133fe8',ramdisk_id='',reservation_id='r-b2qm6gsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1731323280',owner_user_name='tempest-VolumesActionsTest-1731323280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T18:51:35Z,user_data=None,user_id='f203dfc0b2454a2e8b2f5e4c77e9de16',uuid=f1850071-1858-4b9c-be3d-66d9d83aad4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converting VIF {"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG os_vif [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64') {{(pid=74233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43efabc3-caab-5948-8617-866a9c4a79b2', '_type': 'linux-noop'}}, row=False) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdd21dc3-64, may_exist=True, interface_attrs={}) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdd21dc3-64, col_values=(('qos', UUID('48a85354-04b0-4025-a915-8ec53907e0a5')),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdd21dc3-64, col_values=(('external_ids', {'iface-id': 'cdd21dc3-6409-40e6-951f-857eaed273e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:72:4f', 'vm-uuid': 'f1850071-1858-4b9c-be3d-66d9d83aad4d'}),), if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:37 user nova-compute[74233]: INFO os_vif [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64')
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] No VIF found with MAC fa:16:3e:06:72:4f, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Updated VIF entry in instance network info cache for port cdd21dc3-6409-40e6-951f-857eaed273e0. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.neutron [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Updating instance_info_cache with network_info: [{"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-467ee335-1828-4585-89ce-ece15a3f44b0 req-7c7d24b0-d0a8-4edb-bb93-e2016ce7b6c9 service nova] Releasing lock "refresh_cache-f1850071-1858-4b9c-be3d-66d9d83aad4d" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:51:37 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating instance_info_cache with network_info: [{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-5759e21d-6b25-4b15-95a5-b8338cb69266 req-20963b75-aa5c-4d55-a54c-cb90553597c1 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5759e21d-6b25-4b15-95a5-b8338cb69266 req-20963b75-aa5c-4d55-a54c-cb90553597c1 service nova] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5759e21d-6b25-4b15-95a5-b8338cb69266 req-20963b75-aa5c-4d55-a54c-cb90553597c1 service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5759e21d-6b25-4b15-95a5-b8338cb69266 req-20963b75-aa5c-4d55-a54c-cb90553597c1 service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG nova.compute.manager [req-5759e21d-6b25-4b15-95a5-b8338cb69266 req-20963b75-aa5c-4d55-a54c-cb90553597c1 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] No waiting events found dispatching network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:51:38 user nova-compute[74233]: WARNING nova.compute.manager [req-5759e21d-6b25-4b15-95a5-b8338cb69266 req-20963b75-aa5c-4d55-a54c-cb90553597c1 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received unexpected event network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 for instance with vm_state building and task_state spawning.
Oct 20 18:51:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:38 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Instance event wait completed in 0 seconds for  {{(pid=74233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Guest created on hypervisor {{(pid=74233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 18:51:40 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Instance spawned successfully.
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Found default for hw_cdrom_bus of ide {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Found default for hw_disk_bus of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Found default for hw_input_bus of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Found default for hw_pointer_model of None {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Found default for hw_video_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Found default for hw_vif_model of virtio {{(pid=74233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 18:51:40 user nova-compute[74233]: INFO nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Checking state {{(pid=74233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 18:51:40 user nova-compute[74233]: INFO nova.compute.manager [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Took 5.79 seconds to build instance.
Oct 20 18:51:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-dcd3fdcb-1bf2-4414-be27-178d8ded8c0e tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.876s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-9730931b-980d-4914-bad2-1df1e7482d33 req-d2bc26a8-4707-4cc1-8fe1-7ddcc0a98a5f service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9730931b-980d-4914-bad2-1df1e7482d33 req-d2bc26a8-4707-4cc1-8fe1-7ddcc0a98a5f service nova] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9730931b-980d-4914-bad2-1df1e7482d33 req-d2bc26a8-4707-4cc1-8fe1-7ddcc0a98a5f service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-9730931b-980d-4914-bad2-1df1e7482d33 req-d2bc26a8-4707-4cc1-8fe1-7ddcc0a98a5f service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:51:40 user nova-compute[74233]: DEBUG nova.compute.manager [req-9730931b-980d-4914-bad2-1df1e7482d33 req-d2bc26a8-4707-4cc1-8fe1-7ddcc0a98a5f service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] No waiting events found dispatching network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:51:40 user nova-compute[74233]: WARNING nova.compute.manager [req-9730931b-980d-4914-bad2-1df1e7482d33 req-d2bc26a8-4707-4cc1-8fe1-7ddcc0a98a5f service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received unexpected event network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 for instance with vm_state active and task_state None.
Oct 20 18:51:40 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:51:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:42 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:51:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:51:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:51:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:51:47 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:51:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:51:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:51:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:51:52 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:51:57 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:01 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:02 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-changed-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Refreshing instance network info cache due to event network-changed-92ed642f-afa3-4264-9960-59a7bf139293. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] Acquiring lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] Acquired lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Refreshing network info cache for port 92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:04 user nova-compute[74233]: INFO nova.compute.manager [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Terminating instance
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.compute.manager [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa0a6918-0c9a-4165-ad9f-05c9ac8b0424 req-9323e7cd-3489-4c23-8b58-4feecb260ae1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-vif-unplugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa0a6918-0c9a-4165-ad9f-05c9ac8b0424 req-9323e7cd-3489-4c23-8b58-4feecb260ae1 service nova] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa0a6918-0c9a-4165-ad9f-05c9ac8b0424 req-9323e7cd-3489-4c23-8b58-4feecb260ae1 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-aa0a6918-0c9a-4165-ad9f-05c9ac8b0424 req-9323e7cd-3489-4c23-8b58-4feecb260ae1 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa0a6918-0c9a-4165-ad9f-05c9ac8b0424 req-9323e7cd-3489-4c23-8b58-4feecb260ae1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] No waiting events found dispatching network-vif-unplugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-aa0a6918-0c9a-4165-ad9f-05c9ac8b0424 req-9323e7cd-3489-4c23-8b58-4feecb260ae1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-vif-unplugged-92ed642f-afa3-4264-9960-59a7bf139293 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updated VIF entry in instance network info cache for port 92ed642f-afa3-4264-9960-59a7bf139293. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG nova.network.neutron [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating instance_info_cache with network_info: [{"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:52:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-7fb3f3c0-1de1-4ec8-b54f-62991a65555d req-ee163a5d-46ef-48c6-8387-0cffc8ccc2f1 service nova] Releasing lock "refresh_cache-c00683e4-9d50-40cc-b365-ade3d26abdfb" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:52:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Instance destroyed successfully.
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'resources' on Instance uuid c00683e4-9d50-40cc-b365-ade3d26abdfb {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1766705271',display_name='tempest-TestStampPattern-server-1766705271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1766705271',id=50,image_ref='ced7ad6c-0592-4839-ace8-c03da9473658',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWIEzEytNx+0iLAF9D9Qv3+Y3r8LsCO0PwIW8Ba0vdZ2VJMMmSuEA8Xu99yvdhZBUE1N8gxoPVcJJT8rE0rhk05C/y/8pli4AHOH9u2UNcRdFazrgnJROLfVddmOzPrqw==',key_name='tempest-TestStampPattern-1283546229',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:49:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b0543ec4d824458b55850006d926db5',ramdisk_id='',reservation_id='r-w2v5cvz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f98ef9b9-e0f6-453b-a80d-8094a4e7fabc',image_min_disk='1',image_min_ram='0',image_owner_id='9b0543ec4d824458b55850006d926db5',image_owner_project_name='tempest-TestStampPattern-1502495783',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1502495783-project-member',image_user_id='5a55ce39c0754618bee0c15cc7c62194',owner_project_name='tempest-TestStampPattern-1502495783',owner_user_name='tempest-TestStampPattern-1502495783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:49:08Z,user_data=None,user_id='5a55ce39c0754618bee0c15cc7c62194',uuid=c00683e4-9d50-40cc-b365-ade3d26abdfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converting VIF {"id": "92ed642f-afa3-4264-9960-59a7bf139293", "address": "fa:16:3e:bd:8a:cc", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ed642f-af", "ovs_interfaceid": "92ed642f-afa3-4264-9960-59a7bf139293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG os_vif [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92ed642f-af, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0c6c497-2b29-499b-b539-1d35e8c7e154) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:52:05 user nova-compute[74233]: INFO os_vif [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=92ed642f-afa3-4264-9960-59a7bf139293,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ed642f-af')
Oct 20 18:52:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Deleting instance files /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb_del
Oct 20 18:52:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Deletion of /opt/stack/data/nova/instances/c00683e4-9d50-40cc-b365-ade3d26abdfb_del complete
Oct 20 18:52:05 user nova-compute[74233]: INFO nova.compute.manager [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 18:52:05 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:52:05 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Took 0.49 seconds to deallocate network for instance.
Oct 20 18:52:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:52:05 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:06 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Deleted allocations for instance c00683e4-9d50-40cc-b365-ade3d26abdfb
Oct 20 18:52:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-cdb3fb44-b02b-4352-b011-06eb57b2a188 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-0585f45b-923a-40f7-a71e-77a481879128 req-30fb7b4e-9def-4445-b300-98b5705b6bcc service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-vif-deleted-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-50c2b03d-b2ed-4349-81d0-0822b8fce5c7 req-cd76fc53-8c80-4d2e-a922-87d4e0e60732 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received event network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50c2b03d-b2ed-4349-81d0-0822b8fce5c7 req-cd76fc53-8c80-4d2e-a922-87d4e0e60732 service nova] Acquiring lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50c2b03d-b2ed-4349-81d0-0822b8fce5c7 req-cd76fc53-8c80-4d2e-a922-87d4e0e60732 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-50c2b03d-b2ed-4349-81d0-0822b8fce5c7 req-cd76fc53-8c80-4d2e-a922-87d4e0e60732 service nova] Lock "c00683e4-9d50-40cc-b365-ade3d26abdfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-50c2b03d-b2ed-4349-81d0-0822b8fce5c7 req-cd76fc53-8c80-4d2e-a922-87d4e0e60732 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] No waiting events found dispatching network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:52:06 user nova-compute[74233]: WARNING nova.compute.manager [req-50c2b03d-b2ed-4349-81d0-0822b8fce5c7 req-cd76fc53-8c80-4d2e-a922-87d4e0e60732 service nova] [instance: c00683e4-9d50-40cc-b365-ade3d26abdfb] Received unexpected event network-vif-plugged-92ed642f-afa3-4264-9960-59a7bf139293 for instance with vm_state deleted and task_state None.
Oct 20 18:52:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:52:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:24 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:24 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:52:24 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:52:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=24.840904235839844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 248efd4c-164b-49ba-808b-89434fbb5639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f1850071-1858-4b9c-be3d-66d9d83aad4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:52:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:52:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:52:38 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-changed-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG nova.compute.manager [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Refreshing instance network info cache due to event network-changed-c0518cb3-bff0-4ec7-90b1-88234ff403a0. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] Acquiring lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] Acquired lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Refreshing network info cache for port c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:52:39 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updated VIF entry in instance network info cache for port c0518cb3-bff0-4ec7-90b1-88234ff403a0. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG nova.network.neutron [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updating instance_info_cache with network_info: [{"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG nova.objects.instance [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lazy-loading 'info_cache' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fd7a3b04-3ffc-4828-a05e-fcc5037dd715 req-b76b152d-dbe8-4fd0-97ac-18df10e59461 service nova] Releasing lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:52:40 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:41 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:52:44 user nova-compute[74233]: INFO nova.compute.manager [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Attaching volume 0862a3d5-5d78-45f5-b53a-ad18b6177412 to /dev/vdb
Oct 20 18:52:44 user nova-compute[74233]: DEBUG os_brick.utils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9475b2d-497b-4367-92af-b705e720044e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4d8ad125a56\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ab5d0-8409-4dbd-916f-1d4b2058db47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a86f4e-ee28-4e30-acab-13c915953cfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b122ff-c03e-4a46-8992-bb73bb04274a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Running cmd (subprocess): nvme version {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] 'nvme version' failed. Not Retrying. {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] nvme not present on system {{(pid=74233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 18:52:44 user nova-compute[74233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 18:52:44 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a53cb42-f7bf-4846-829d-0c8ed0780a65]: (4, '') {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.lightos [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] LIGHTOS: no hostnqn found. {{(pid=74233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG os_brick.utils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4d8ad125a56', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:52:44 user nova-compute[74233]: DEBUG nova.virt.block_device [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updating existing volume attachment record: 82dc7a0a-512f-4914-aeb0-23f780d38ebb {{(pid=74233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 18:52:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:46 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:52:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:52:57 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:52:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:52:57 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:53:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:53:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:53:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:53:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Calling os-brick to attach iSCSI Volume {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgWAFytG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:53:10 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:53:10 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:53:10 user nova-compute[74233]: INFO os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0bb82b-7ef7-4278-983a-27398e9e7605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 18:53:10 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --interface default --op new {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f27073-69fa-46b6-8200-dabbb3733e67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412] added\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412] added
Oct 20 18:53:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28897461-19ad-496f-85b1-388e14fc67e5]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6defa72-e949-4002-990b-5a2d11e1f836]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgWAFytG {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgWAFytG" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a86948-558b-48cf-8bc1-0413da3b933a]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgWAFytG'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5ba287-2cbb-4031-b1cc-9cc2ee2e1d36]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05193d9-6172-422e-8ba4-6dc1a48e4207]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:53:10 user nova-compute[74233]:  {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 18:53:10 user nova-compute[74233]:  {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:53:10 user nova-compute[74233]: WARNING os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 18:53:10 user nova-compute[74233]: 
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --login {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea10bd-da2a-4b99-85f6-609f3c01c8da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260]
Oct 20 18:53:10 user nova-compute[74233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260] successful.
Oct 20 18:53:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194dfca-5137-46b6-a075-9602dfba85ff]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f36fd-44ea-4a16-be67-5d27ad108e85]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 (non-flash)
Oct 20 18:53:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 (non-flash)
Oct 20 18:53:10 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Connected to 172.16.0.220:3260 {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6b0b5-9512-4d22-8869-bcf4f7b3da01]: (4, ('- - 0', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 18:53:10 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgWAFytG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 18:53:11 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:53:11 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26630393562623465', 'path': '/dev/sdb'} {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:53:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630393562623465', 'path': '/dev/sdb'} {{(pid=74233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 18:53:11 user nova-compute[74233]: DEBUG nova.objects.instance [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:53:11 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 18:53:11 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:53:11 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:53:11 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:53:11 user nova-compute[74233]:   <serial>0862a3d5-5d78-45f5-b53a-ad18b6177412</serial>
Oct 20 18:53:11 user nova-compute[74233]: </disk>
Oct 20 18:53:11 user nova-compute[74233]:  {{(pid=74233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 18:53:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:53:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 18:53:12 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] No VIF found with MAC fa:16:3e:80:12:bc, not building metadata {{(pid=74233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 18:53:12 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-e17f362b-93bb-42c4-b1e1-d299dc6eb349 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.961s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:13 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:13 user nova-compute[74233]: INFO nova.compute.manager [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Detaching volume 0862a3d5-5d78-45f5-b53a-ad18b6177412
Oct 20 18:53:14 user nova-compute[74233]: INFO nova.virt.block_device [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Attempting to driver detach volume 0862a3d5-5d78-45f5-b53a-ad18b6177412 from mountpoint /dev/vdb
Oct 20 18:53:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Attempting to detach device vdb from instance 248efd4c-164b-49ba-808b-89434fbb5639 from the persistent domain config. {{(pid=74233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 18:53:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:53:14 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:53:14 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:53:14 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:53:14 user nova-compute[74233]:   <serial>0862a3d5-5d78-45f5-b53a-ad18b6177412</serial>
Oct 20 18:53:14 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:53:14 user nova-compute[74233]: </disk>
Oct 20 18:53:14 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:53:14 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully detached device vdb from instance 248efd4c-164b-49ba-808b-89434fbb5639 from the persistent domain config.
Oct 20 18:53:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 248efd4c-164b-49ba-808b-89434fbb5639 from the live domain config. {{(pid=74233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 18:53:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.guest [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 18:53:14 user nova-compute[74233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 18:53:14 user nova-compute[74233]:   <source dev="/dev/sdb"/>
Oct 20 18:53:14 user nova-compute[74233]:   <target dev="vdb" bus="virtio"/>
Oct 20 18:53:14 user nova-compute[74233]:   <serial>0862a3d5-5d78-45f5-b53a-ad18b6177412</serial>
Oct 20 18:53:14 user nova-compute[74233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 18:53:14 user nova-compute[74233]: </disk>
Oct 20 18:53:14 user nova-compute[74233]:  {{(pid=74233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 18:53:14 user nova-compute[74233]: DEBUG nova.virt.libvirt.driver [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 18:53:14 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-changed-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.compute.manager [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Refreshing instance network info cache due to event network-changed-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af. {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] Acquiring lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] Acquired lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Refreshing network info cache for port 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:15 user nova-compute[74233]: INFO nova.compute.manager [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Terminating instance
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.compute.manager [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updated VIF entry in instance network info cache for port 6c5bbc58-84b1-4fba-a41f-f466a6f4b3af. {{(pid=74233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.network.neutron [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [{"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:53:15 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e0e8d25d-dbb4-4ffb-9416-fbf93e6e01a0 req-ce7b42c4-cd60-49ea-8936-5b2ee1131924 service nova] Releasing lock "refresh_cache-f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:53:15 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Instance destroyed successfully.
Oct 20 18:53:15 user nova-compute[74233]: DEBUG nova.objects.instance [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lazy-loading 'resources' on Instance uuid f98ef9b9-e0f6-453b-a80d-8094a4e7fabc {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-671119680',display_name='tempest-TestStampPattern-server-671119680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-671119680',id=47,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWIEzEytNx+0iLAF9D9Qv3+Y3r8LsCO0PwIW8Ba0vdZ2VJMMmSuEA8Xu99yvdhZBUE1N8gxoPVcJJT8rE0rhk05C/y/8pli4AHOH9u2UNcRdFazrgnJROLfVddmOzPrqw==',key_name='tempest-TestStampPattern-1283546229',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:45:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b0543ec4d824458b55850006d926db5',ramdisk_id='',reservation_id='r-5j7y04yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1502495783',owner_user_name='tempest-TestStampPattern-1502495783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:48:58Z,user_data=None,user_id='5a55ce39c0754618bee0c15cc7c62194',uuid=f98ef9b9-e0f6-453b-a80d-8094a4e7fabc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converting VIF {"id": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "address": "fa:16:3e:74:59:43", "network": {"id": "82a8722c-9c48-4c2a-b5bc-5fd21946ee83", "bridge": "br-int", "label": "tempest-TestStampPattern-1787277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b0543ec4d824458b55850006d926db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5bbc58-84", "ovs_interfaceid": "6c5bbc58-84b1-4fba-a41f-f466a6f4b3af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG os_vif [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c5bbc58-84, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b43ab7e-75c5-4d7b-9f33-680c65010860) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:16 user nova-compute[74233]: INFO os_vif [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:59:43,bridge_name='br-int',has_traffic_filtering=True,id=6c5bbc58-84b1-4fba-a41f-f466a6f4b3af,network=Network(82a8722c-9c48-4c2a-b5bc-5fd21946ee83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5bbc58-84')
Oct 20 18:53:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Deleting instance files /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc_del
Oct 20 18:53:16 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Deletion of /opt/stack/data/nova/instances/f98ef9b9-e0f6-453b-a80d-8094a4e7fabc_del complete
Oct 20 18:53:16 user nova-compute[74233]: INFO nova.compute.manager [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 18:53:16 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:53:16 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Took 0.79 seconds to deallocate network for instance.
Oct 20 18:53:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:16 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:17 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Deleted allocations for instance f98ef9b9-e0f6-453b-a80d-8094a4e7fabc
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-vif-unplugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] No waiting events found dispatching network-vif-unplugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:53:17 user nova-compute[74233]: WARNING nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received unexpected event network-vif-unplugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af for instance with vm_state deleted and task_state None.
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] Acquiring lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] No waiting events found dispatching network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:53:17 user nova-compute[74233]: WARNING nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received unexpected event network-vif-plugged-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af for instance with vm_state deleted and task_state None.
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [req-fe207504-d580-4a8a-a5ba-179ee765c621 req-b640a35e-82d0-4b87-842a-6c30a1a639b5 service nova] [instance: f98ef9b9-e0f6-453b-a80d-8094a4e7fabc] Received event network-vif-deleted-6c5bbc58-84b1-4fba-a41f-f466a6f4b3af {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-5662e522-5b79-4ec7-a1c5-d8a14c53d143 tempest-TestStampPattern-1502495783 tempest-TestStampPattern-1502495783-project-member] Lock "f98ef9b9-e0f6-453b-a80d-8094a4e7fabc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Triggering sync for uuid f1850071-1858-4b9c-be3d-66d9d83aad4d {{(pid=74233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:17 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:53:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:22 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:25 user nova-compute[74233]: INFO nova.compute.manager [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Terminating instance
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9f6bbdc-314c-4428-830e-75efa9dcf2a7 req-ec4066e0-953e-4c5a-8548-8fd8d1512d9f service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-vif-unplugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9f6bbdc-314c-4428-830e-75efa9dcf2a7 req-ec4066e0-953e-4c5a-8548-8fd8d1512d9f service nova] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9f6bbdc-314c-4428-830e-75efa9dcf2a7 req-ec4066e0-953e-4c5a-8548-8fd8d1512d9f service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-e9f6bbdc-314c-4428-830e-75efa9dcf2a7 req-ec4066e0-953e-4c5a-8548-8fd8d1512d9f service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9f6bbdc-314c-4428-830e-75efa9dcf2a7 req-ec4066e0-953e-4c5a-8548-8fd8d1512d9f service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] No waiting events found dispatching network-vif-unplugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.compute.manager [req-e9f6bbdc-314c-4428-830e-75efa9dcf2a7 req-ec4066e0-953e-4c5a-8548-8fd8d1512d9f service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-vif-unplugged-cdd21dc3-6409-40e6-951f-857eaed273e0 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:53:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Instance destroyed successfully.
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.objects.instance [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lazy-loading 'resources' on Instance uuid f1850071-1858-4b9c-be3d-66d9d83aad4d {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1320037702',display_name='tempest-VolumesActionsTest-instance-1320037702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1320037702',id=52,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31b5963ae3b94c3a876cc013c8133fe8',ramdisk_id='',reservation_id='r-b2qm6gsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1731323280',owner_user_name='tempest-VolumesActionsTest-1731323280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:51:41Z,user_data=None,user_id='f203dfc0b2454a2e8b2f5e4c77e9de16',uuid=f1850071-1858-4b9c-be3d-66d9d83aad4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converting VIF {"id": "cdd21dc3-6409-40e6-951f-857eaed273e0", "address": "fa:16:3e:06:72:4f", "network": {"id": "fbbde1c1-6255-48de-8740-0a38535fa598", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31b5963ae3b94c3a876cc013c8133fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd21dc3-64", "ovs_interfaceid": "cdd21dc3-6409-40e6-951f-857eaed273e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG os_vif [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdd21dc3-64, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48a85354-04b0-4025-a915-8ec53907e0a5) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:25 user nova-compute[74233]: INFO os_vif [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:72:4f,bridge_name='br-int',has_traffic_filtering=True,id=cdd21dc3-6409-40e6-951f-857eaed273e0,network=Network(fbbde1c1-6255-48de-8740-0a38535fa598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd21dc3-64')
Oct 20 18:53:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Deleting instance files /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d_del
Oct 20 18:53:25 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Deletion of /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d_del complete
Oct 20 18:53:25 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000034, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/f1850071-1858-4b9c-be3d-66d9d83aad4d/disk
Oct 20 18:53:25 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:26 user nova-compute[74233]: INFO nova.compute.manager [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-09596fe0-46d4-4d0b-82a9-0fd92f50c9fb req-58cbe698-0585-4003-aaf1-4a79c75f4e33 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-vif-deleted-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:26 user nova-compute[74233]: INFO nova.compute.manager [req-09596fe0-46d4-4d0b-82a9-0fd92f50c9fb req-58cbe698-0585-4003-aaf1-4a79c75f4e33 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Neutron deleted interface cdd21dc3-6409-40e6-951f-857eaed273e0; detaching it from the instance and deleting it from the info cache
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.network.neutron [req-09596fe0-46d4-4d0b-82a9-0fd92f50c9fb req-58cbe698-0585-4003-aaf1-4a79c75f4e33 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:53:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:53:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=8895MB free_disk=24.964710235595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.manager [req-09596fe0-46d4-4d0b-82a9-0fd92f50c9fb req-58cbe698-0585-4003-aaf1-4a79c75f4e33 service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Detach interface failed, port_id=cdd21dc3-6409-40e6-951f-857eaed273e0, reason: Instance f1850071-1858-4b9c-be3d-66d9d83aad4d could not be found. {{(pid=74233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 18:53:26 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Took 0.69 seconds to deallocate network for instance.
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance 248efd4c-164b-49ba-808b-89434fbb5639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Instance f1850071-1858-4b9c-be3d-66d9d83aad4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.161s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:27 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Deleted allocations for instance f1850071-1858-4b9c-be3d-66d9d83aad4d
Oct 20 18:53:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-333e4b4b-e6a1-4f75-8067-6617f503455c tempest-VolumesActionsTest-1731323280 tempest-VolumesActionsTest-1731323280-project-member] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-90011c77-54ed-455f-b061-1d9d5bf2d10d req-89799164-61a2-4f97-8545-05bea7c9ef7a service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received event network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-90011c77-54ed-455f-b061-1d9d5bf2d10d req-89799164-61a2-4f97-8545-05bea7c9ef7a service nova] Acquiring lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-90011c77-54ed-455f-b061-1d9d5bf2d10d req-89799164-61a2-4f97-8545-05bea7c9ef7a service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-90011c77-54ed-455f-b061-1d9d5bf2d10d req-89799164-61a2-4f97-8545-05bea7c9ef7a service nova] Lock "f1850071-1858-4b9c-be3d-66d9d83aad4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:27 user nova-compute[74233]: DEBUG nova.compute.manager [req-90011c77-54ed-455f-b061-1d9d5bf2d10d req-89799164-61a2-4f97-8545-05bea7c9ef7a service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] No waiting events found dispatching network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:53:27 user nova-compute[74233]: WARNING nova.compute.manager [req-90011c77-54ed-455f-b061-1d9d5bf2d10d req-89799164-61a2-4f97-8545-05bea7c9ef7a service nova] [instance: f1850071-1858-4b9c-be3d-66d9d83aad4d] Received unexpected event network-vif-plugged-cdd21dc3-6409-40e6-951f-857eaed273e0 for instance with vm_state deleted and task_state None.
Oct 20 18:53:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:34 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 248efd4c-164b-49ba-808b-89434fbb5639 is timed out.
Oct 20 18:53:34 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully detached device vdb from instance 248efd4c-164b-49ba-808b-89434fbb5639 from the live domain config.
Oct 20 18:53:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] calling os-brick to detach iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb970514070>, {'target_iqn': 'iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgWAFytG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 18:53:34 user nova-compute[74233]: WARNING os_brick.initiator.connectors.base [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc7aa5-2a4c-472f-89e9-7f2f32d6d72e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 18:53:34 user nova-compute[74233]: No targets found.
Oct 20 18:53:34 user nova-compute[74233]: iSNS:
Oct 20 18:53:34 user nova-compute[74233]: No targets found.
Oct 20 18:53:34 user nova-compute[74233]: STATIC:
Oct 20 18:53:34 user nova-compute[74233]: Target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412
Oct 20 18:53:34 user nova-compute[74233]:         Portal: 172.16.0.220:3260,-1
Oct 20 18:53:34 user nova-compute[74233]:                 Iface Name: default
Oct 20 18:53:34 user nova-compute[74233]: FIRMWARE:
Oct 20 18:53:34 user nova-compute[74233]: No targets found.
Oct 20 18:53:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 18:53:34 user nova-compute[74233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 18:53:34 user nova-compute[74233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412', 0)] {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42ce259-a335-4f11-a623-57a9409b0e82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe6e0e0-63d3-48e1-8cce-dd7eced8d0bc]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 (non-flash)\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 (non-flash)
Oct 20 18:53:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 (non-flash)
Oct 20 18:53:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb97052e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412'): ({'sdb'}, set())}) {{(pid=74233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Removing single pathed devices sdb {{(pid=74233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80706204-49e6-4ad9-94ca-93ec7bb68de5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4d20a-f2f7-4f49-bdf1-a41d7395a61a]: (4, ('ok\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Flushing IO for device /dev/sdb {{(pid=74233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170c363-493b-43c0-acef-5dea89f0aebe]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a752bc-003d-4b32-bbc0-d437c09cb789]: (4, ('1', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.linuxscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] SCSI volumes sdb have been removed. {{(pid=74233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412')] {{(pid=74233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d91e57-6632-4fb5-88ef-93fc3e7e95f2]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --logout {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9e428-5937-4665-82e5-bbc630be0ad5]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260]
Oct 20 18:53:34 user nova-compute[74233]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412, portal: 172.16.0.220,3260] successful.
Oct 20 18:53:34 user nova-compute[74233]:  stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op delete {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0862a3d5-5d78-45f5-b53a-ad18b6177412 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2c6eed-f6e1-44ba-ac89-394e9ac39df0]: (4, ('', '')) {{(pid=85316) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.base [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] <== disconnect_volume: return (323ms) None {{(pid=74233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 18:53:34 user nova-compute[74233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Disconnected iSCSI Volume {{(pid=74233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 18:53:35 user nova-compute[74233]: DEBUG nova.objects.instance [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'flavor' on Instance uuid 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:53:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-bc902e93-e6dc-409f-be36-332586776d29 tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "248efd4c-164b-49ba-808b-89434fbb5639" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.065s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:53:35 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "248efd4c-164b-49ba-808b-89434fbb5639" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:53:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:38 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:41 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:41 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquired lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Forcefully refreshing network info cache for instance {{(pid=74233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG nova.network.neutron [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updating instance_info_cache with network_info: [{"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Releasing lock "refresh_cache-248efd4c-164b-49ba-808b-89434fbb5639" {{(pid=74233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updated the network info_cache for instance {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 18:53:42 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:53:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:53:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:53:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:53:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:53:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:53:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:04 user nova-compute[74233]: INFO nova.compute.manager [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Terminating instance
Oct 20 18:54:04 user nova-compute[74233]: DEBUG nova.compute.manager [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Start destroying the instance on the hypervisor. {{(pid=74233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e2438ec-876c-4051-9550-58388fba7533 req-e8491eb1-ddbc-41ab-b42f-9f32b5800e27 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-vif-unplugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e2438ec-876c-4051-9550-58388fba7533 req-e8491eb1-ddbc-41ab-b42f-9f32b5800e27 service nova] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e2438ec-876c-4051-9550-58388fba7533 req-e8491eb1-ddbc-41ab-b42f-9f32b5800e27 service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-5e2438ec-876c-4051-9550-58388fba7533 req-e8491eb1-ddbc-41ab-b42f-9f32b5800e27 service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e2438ec-876c-4051-9550-58388fba7533 req-e8491eb1-ddbc-41ab-b42f-9f32b5800e27 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] No waiting events found dispatching network-vif-unplugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:54:04 user nova-compute[74233]: DEBUG nova.compute.manager [req-5e2438ec-876c-4051-9550-58388fba7533 req-e8491eb1-ddbc-41ab-b42f-9f32b5800e27 service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-vif-unplugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 for instance with task_state deleting. {{(pid=74233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [-] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Instance destroyed successfully.
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.objects.instance [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lazy-loading 'resources' on Instance uuid 248efd4c-164b-49ba-808b-89434fbb5639 {{(pid=74233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.virt.libvirt.vif [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T18:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2074515100',display_name='tempest-AttachVolumeNegativeTest-server-2074515100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2074515100',id=51,image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+IhEE5cm6d0sST+6VY2Gy2FywqSds6/7QKp03xlpVt/oJbIfb4sIYtcMWnYFdl7Ai74H/jAC7UQ85LIt8rLTIOrxsRA4qMMTVxH6Jky0muUQU3MkLofVj7duy6KIQYrA==',key_name='tempest-keypair-1101056717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T18:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a650cec6e38447d5a36decea9b4f4a30',ramdisk_id='',reservation_id='r-qukrea1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaa6d842-3abb-4a80-92cd-b9a50e121c9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-375409870',owner_user_name='tempest-AttachVolumeNegativeTest-375409870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T18:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efaee4f6f36e458184f3aa737affdbc2',uuid=248efd4c-164b-49ba-808b-89434fbb5639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converting VIF {"id": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "address": "fa:16:3e:80:12:bc", "network": {"id": "f5beead3-2f5a-4010-bd20-ba346fc59ef4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-234567149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a650cec6e38447d5a36decea9b4f4a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0518cb3-bf", "ovs_interfaceid": "c0518cb3-bff0-4ec7-90b1-88234ff403a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.network.os_vif_util [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf') {{(pid=74233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG os_vif [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf') {{(pid=74233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0518cb3-bf, bridge=br-int, if_exists=True) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f4fc524-7890-4f18-a9ad-f53ae03d2df4) {{(pid=74233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:05 user nova-compute[74233]: INFO os_vif [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:12:bc,bridge_name='br-int',has_traffic_filtering=True,id=c0518cb3-bff0-4ec7-90b1-88234ff403a0,network=Network(f5beead3-2f5a-4010-bd20-ba346fc59ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0518cb3-bf')
Oct 20 18:54:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Deleting instance files /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639_del
Oct 20 18:54:05 user nova-compute[74233]: INFO nova.virt.libvirt.driver [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Deletion of /opt/stack/data/nova/instances/248efd4c-164b-49ba-808b-89434fbb5639_del complete
Oct 20 18:54:05 user nova-compute[74233]: INFO nova.compute.manager [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 18:54:05 user nova-compute[74233]: DEBUG oslo.service.loopingcall [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.compute.manager [-] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Deallocating network for instance {{(pid=74233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] deallocate_for_instance() {{(pid=74233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 20 18:54:05 user nova-compute[74233]: DEBUG nova.network.neutron [-] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Updating instance_info_cache with network_info: [] {{(pid=74233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 18:54:05 user nova-compute[74233]: INFO nova.compute.manager [-] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Took 0.70 seconds to deallocate network for instance.
Oct 20 18:54:05 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:06 user nova-compute[74233]: INFO nova.scheduler.client.report [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Deleted allocations for instance 248efd4c-164b-49ba-808b-89434fbb5639
Oct 20 18:54:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-a7f0f8d8-78b4-4237-be4e-0faa8c688f0b tempest-AttachVolumeNegativeTest-375409870 tempest-AttachVolumeNegativeTest-375409870-project-member] Lock "248efd4c-164b-49ba-808b-89434fbb5639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] Acquiring lock "248efd4c-164b-49ba-808b-89434fbb5639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] Lock "248efd4c-164b-49ba-808b-89434fbb5639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] No waiting events found dispatching network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 18:54:06 user nova-compute[74233]: WARNING nova.compute.manager [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received unexpected event network-vif-plugged-c0518cb3-bff0-4ec7-90b1-88234ff403a0 for instance with vm_state deleted and task_state None.
Oct 20 18:54:06 user nova-compute[74233]: DEBUG nova.compute.manager [req-493a0ff8-efe9-45de-ab24-62994e085ec3 req-0f0b38e8-74ba-48f0-96f5-957daeddfe8e service nova] [instance: 248efd4c-164b-49ba-808b-89434fbb5639] Received event network-vif-deleted-c0518cb3-bff0-4ec7-90b1-88234ff403a0 {{(pid=74233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 18:54:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:18 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:20 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:20 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:54:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:25 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:54:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:54:26 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:54:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=25.01885223388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:54:26 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:54:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:40 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:42 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:54:42 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:54:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:54:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:54:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:54:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:54:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:54:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:54:56 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:55:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:55:24 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:55:27 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:55:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:55:28 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:55:28 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=25.009258270263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:55:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:55:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:55:35 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:55:40 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:55:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:55:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:55:44 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:55:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:55:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:55:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:55:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:55:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:55:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:56:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:56:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:56:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:56:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:21 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:21 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:56:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:56:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:56:28 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:56:28 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:56:29 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:56:29 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:56:29 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9186MB free_disk=25.007972717285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:56:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:56:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:35 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:42 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:56:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:56:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:56:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:56:45 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:56:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:56:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:56:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:56:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:56:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:57:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:57:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:57:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:21 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:23 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:57:23 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:57:29 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:57:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:57:30 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9186MB free_disk=25.00661849975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing inventories for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating ProviderTree inventory for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Updating inventory in ProviderTree for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing aggregate associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, aggregates: None {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Refreshing trait associations for resource provider cc4059c5-9fe5-4cfa-b006-c468906869b2, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV {{(pid=74233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:57:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:57:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:37 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:57:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:57:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:57:46 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:57:46 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=74233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 18:57:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:57:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:57:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:57:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:57:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:57:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:00 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Cleaning up deleted instances {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 18:58:00 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] There are 0 instances to clean {{(pid=74233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 18:58:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:58:08 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:58:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:58:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:58:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:58:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:25 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:25 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:58:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:58:30 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:58:31 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:58:31 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:58:31 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=25.00503921508789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:58:31 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:58:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:37 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:58:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:44 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:58:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:58:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:58:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:58:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:58:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:58:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:59:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:59:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:59:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:27 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:27 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 18:59:28 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:59:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:59:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:31 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:59:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:59:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:59:32 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 18:59:33 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:59:33 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 18:59:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9180MB free_disk=25.003463745117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 18:59:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 18:59:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:59:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:59:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:39 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:40 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:43 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:45 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:47 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 18:59:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Starting heal instance info cache {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 18:59:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Rebuilding the list of instances to heal {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 18:59:47 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Didn't find any instances for network info cache update. {{(pid=74233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 18:59:50 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 18:59:55 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 19:00:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 19:00:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 19:00:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 19:00:00 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 19:00:05 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 19:00:10 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:15 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:20 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:25 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:29 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 19:00:29 user nova-compute[74233]: DEBUG nova.compute.manager [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 19:00:30 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 19:00:32 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Auditing locally available compute resources for user (node: user) {{(pid=74233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 19:00:33 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 19:00:33 user nova-compute[74233]: WARNING nova.virt.libvirt.driver [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 19:00:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Hypervisor/Node resource view: name=user free_ram=9298MB free_disk=24.999961853027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG nova.compute.provider_tree [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed in ProviderTree for provider: cc4059c5-9fe5-4cfa-b006-c468906869b2 {{(pid=74233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG nova.scheduler.client.report [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Inventory has not changed for provider cc4059c5-9fe5-4cfa-b006-c468906869b2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG nova.compute.resource_tracker [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Compute_service record updated for user:user {{(pid=74233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 19:00:33 user nova-compute[74233]: DEBUG oslo_concurrency.lockutils [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=74233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 19:00:35 user nova-compute[74233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 19:00:35 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 19:00:39 user nova-compute[74233]: DEBUG oslo_service.periodic_task [None req-70eb05c9-92f8-4ad4-a034-45c7b0f0d1ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}